Max level shown:
1 [ Mar 22 05:00:15 Enabled. ]
2 [ Mar 22 05:00:15 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 22 05:00:15 Method "start" exited with status 0. ]
4 [ Mar 22 05:00:15 Rereading configuration. ]
5 [ Mar 22 05:00:15 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-22T05:00:15.756ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-22T05:00:15.756ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-22T05:00:15.809ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-22T05:00:15.809ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-22T05:00:15.923ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-22T05:00:15.932ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-22T05:00:15.941ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-22T05:00:16.553ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
152025-03-22T05:00:16.554ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }]
162025-03-22T05:00:16.555ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
172025-03-22T05:00:16.682ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-22T05:00:16.682ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-22T05:00:16.682ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-22T05:00:16.682ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
212025-03-22T05:00:16.682ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
222025-03-22T05:00:16.682ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
232025-03-22T05:00:16.685ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-22T05:00:16.685ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-22T05:00:16.685ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-22T05:00:16.685ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-22T05:00:16.686ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-22T05:00:16.686ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-22T05:00:16.686ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-22T05:00:16.686ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-22T05:00:16.686ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-22T05:00:16.698ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-22T05:00:16.698ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool)
342025-03-22T05:00:16.794ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal }
352025-03-22T05:00:17.159ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-22T05:00:17.159ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-22T05:00:17.159ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-22T05:00:17.159ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-22T05:00:17.159ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-22T05:00:17.159ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-22T05:00:17.159ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-22T05:00:17.168ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-22T05:00:17.168ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool)
442025-03-22T05:00:17.255ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal }
452025-03-22T05:00:17.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-22T05:00:17.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
492025-03-22T05:00:17.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
502025-03-22T05:00:17.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-22T05:00:17.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-22T05:00:17.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
542025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
552025-03-22T05:00:17.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
562025-03-22T05:00:17.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-22T05:00:17.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
582025-03-22T05:00:17.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
602025-03-22T05:00:17.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
612025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
622025-03-22T05:00:17.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-22T05:00:17.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-22T05:00:17.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-22T05:00:17.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-22T05:00:17.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-22T05:00:17.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-22T05:00:17.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-22T05:00:17.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-22T05:00:17.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-22T05:00:17.627ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-22T05:00:17.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
782025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
792025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
802025-03-22T05:00:17.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
812025-03-22T05:00:17.627ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
832025-03-22T05:00:17.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842025-03-22T05:00:17.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
852025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
862025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
872025-03-22T05:00:17.627ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
882025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892025-03-22T05:00:17.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902025-03-22T05:00:17.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
922025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
932025-03-22T05:00:17.627ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
942025-03-22T05:00:17.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
972025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
982025-03-22T05:00:17.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
992025-03-22T05:00:17.627ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-22T05:00:17.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-22T05:00:17.627ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1032025-03-22T05:00:17.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1042025-03-22T05:00:17.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1052025-03-22T05:00:17.627ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1072025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1082025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1092025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1102025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1112025-03-22T05:00:17.627ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1122025-03-22T05:00:17.627ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-22T05:00:17.627ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-22T05:00:17.638ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:803
1152025-03-22T05:00:17.638ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 1414, tv_nsec: 602511652 } time_to_next_cleanup = 599.999951219s
1162025-03-22T05:00:17.638ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4081
1172025-03-22T05:00:17.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-22T05:00:17.638ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-22T05:00:17.638ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-22T05:00:17.642ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1212025-03-22T05:00:17.643ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1222025-03-22T05:00:17.643ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1136
1232025-03-22T05:00:17.643ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-22T05:00:17.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-22T05:00:17.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-22T05:00:17.643ZINFOSledAgent (RSS): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-22T05:00:17.643ZINFOSledAgent (RSS): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-22T05:00:17.643ZINFOSledAgent (RSS): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-22T05:00:17.643ZINFOSledAgent (RSS): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-22T05:00:17.643ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1185
1312025-03-22T05:00:17.643ZINFOSledAgent (RSS): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-22T05:00:17.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-22T05:00:17.644ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1217
1342025-03-22T05:00:17.644ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-22T05:00:17.644ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-22T05:00:17.644ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1248
1372025-03-22T05:00:17.644ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382025-03-22T05:00:17.644ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1392025-03-22T05:00:17.644ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1402025-03-22T05:00:17.644ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412025-03-22T05:00:17.644ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f634dba2-8c5d-4b36-ba71-7efa6e33985c (sled), rack_id: 5a80395d-2a13-488f-b69d-b25376304a78, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422025-03-22T05:00:17.646ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4378
1432025-03-22T05:00:17.646ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4799
1442025-03-22T05:00:17.650ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-22T05:00:17.656ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-22T05:00:17.657ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-22T05:00:17.661ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-22T05:00:17.661ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-22T05:00:17.661ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:61563
1502025-03-22T05:00:17.661ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f634dba2-8c5d-4b36-ba71-7efa6e33985c (sled), rack_id: 5a80395d-2a13-488f-b69d-b25376304a78, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:356
1512025-03-22T05:00:17.661ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:371
1522025-03-22T05:00:17.661ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-22T05:00:17.661ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1552025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-22T05:00:17.661ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
1622025-03-22T05:00:17.661ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-22T05:00:17.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-22T05:00:17.700ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:356
1652025-03-22T05:00:17.718ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:394
1662025-03-22T05:00:17.725ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1672025-03-22T05:00:17.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1682025-03-22T05:00:17.725ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1692025-03-22T05:00:17.725ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
1702025-03-22T05:00:17.728ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6fbc06eb-2c35-4995-9eb0-c5b5bdd8fa34", "content-length": "124", "date": "Sat, 22 Mar 2025 05:00:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6fbc06eb-2c35-4995-9eb0-c5b5bdd8fa34" } file = sled-agent/src/ddm_reconciler.rs:206
1712025-03-22T05:00:17.728ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
1722025-03-22T05:00:17.728ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1732025-03-22T05:00:17.728ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
1742025-03-22T05:00:17.739ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_6c2d1b67-1f24-400b-ac37-175a47067aad/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-22T05:00:17.763ZINFOSledAgent: successfully created encrypted zvol: name="oxi_6c2d1b67-1f24-400b-ac37-175a47067aad/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-22T05:00:17.763ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_6c2d1b67-1f24-400b-ac37-175a47067aad/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-22T05:00:17.768ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1782025-03-22T05:00:17.768ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-22T05:00:17.768ZINFOSledAgent (BackingFs): Ensuring dataset oxi_6c2d1b67-1f24-400b-ac37-175a47067aad/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-22T05:00:17.844ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-22T05:00:18.063ZINFOSledAgent (BackingFs): Mounting oxi_6c2d1b67-1f24-400b-ac37-175a47067aad/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-22T05:00:18.075ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-22T05:00:18.075ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-22T05:00:18.075ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-22T05:00:18.075ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-22T05:00:18.818ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1872025-03-22T05:00:18.824ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:35639 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1882025-03-22T05:00:18.824ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1892025-03-22T05:00:18.824ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:35639 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1902025-03-22T05:00:18.825ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 199.679521ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1912025-03-22T05:00:18.826ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1922025-03-22T05:00:18.826ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1932025-03-22T05:00:18.826ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:990 underlay_address = fd00:1122:3344:101::1
1942025-03-22T05:00:18.826ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-22T05:00:19.027ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 559.274204ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1962025-03-22T05:00:19.588ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.404344341s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1972025-03-22T05:00:20.994ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.379374741s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
1982025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2757
1992025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2987
2002025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2627
2012025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2674
2022025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3068
2032025-03-22T05:00:21.704ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3113
2042025-03-22T05:00:21.706ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2895
2052025-03-22T05:00:21.708ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2668
2062025-03-22T05:00:21.708ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='9abdb2e0-f56e-4d00-b2ba-62a79885d1fc'/> <propval type="astring" name="rack_id" value='5a80395d-2a13-488f-b69d-b25376304a78'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fee0:cf97'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='5a80395d-2a13-488f-b69d-b25376304a78'/> <propval type="astring" name="sled_id" value='f634dba2-8c5d-4b36-ba71-7efa6e33985c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='5a80395d-2a13-488f-b69d-b25376304a78'/> <propval type="astring" name="sled_id" value='f634dba2-8c5d-4b36-ba71-7efa6e33985c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='f634dba2-8c5d-4b36-ba71-7efa6e33985c'/> <propval type="astring" name="rack_uuid" value='5a80395d-2a13-488f-b69d-b25376304a78'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='f634dba2-8c5d-4b36-ba71-7efa6e33985c'/> <propval type="astring" name="rack_uuid" value='5a80395d-2a13-488f-b69d-b25376304a78'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2072025-03-22T05:00:21.708ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2082025-03-22T05:00:22.006ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 58.049787ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2092025-03-22T05:00:22.225ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 129.504861ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-22T05:00:22.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 177.167532ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-22T05:00:22.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 386.186257ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-22T05:00:23.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 784.755146ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-03-22T05:00:23.375ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.28208527s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2142025-03-22T05:00:24.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 552.754186ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-22T05:00:24.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 914.374318ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-22T05:00:25.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 944.729874ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-22T05:00:26.659ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.120937766s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2182025-03-22T05:00:26.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 528.052738ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-03-22T05:00:27.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2202025-03-22T05:00:27.867ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2212025-03-22T05:00:27.867ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2222025-03-22T05:00:27.899ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2232025-03-22T05:00:27.900ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2242025-03-22T05:00:27.900ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:411
2252025-03-22T05:00:27.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-03-22T05:00:27.900ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2272025-03-22T05:00:27.900ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2282025-03-22T05:00:27.900ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2292025-03-22T05:00:27.900ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2302025-03-22T05:00:27.900ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4081
2312025-03-22T05:00:27.900ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:61563
2322025-03-22T05:00:28.081ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2332025-03-22T05:00:28.081ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2342025-03-22T05:00:28.088ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4402 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2352025-03-22T05:00:28.088ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4418
2362025-03-22T05:00:28.088ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2372025-03-22T05:00:28.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34209
2382025-03-22T05:00:28.359ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2392025-03-22T05:00:28.359ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2402025-03-22T05:00:28.359ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:186
2412025-03-22T05:00:28.359ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:186
2422025-03-22T05:00:28.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34209 req_id = 7b0dd07f-71c7-405b-ae1b-09d51a2c8393 response_code = 200 uri = /inventory
2432025-03-22T05:00:28.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46749
2442025-03-22T05:00:28.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46749 req_id = 07fe81e6-b97e-4bb6-ab6e-5cd2672603ec response_code = 200 uri = /sled-role
2452025-03-22T05:00:28.424ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(2), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 47dabbcc-ec67-4cf5-9fdc-e29896133239 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: e268e517-be89-4885-8e3a-f954a2bf9ab5 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eca08ebf-6363-457d-ac26-a0e32f33ca2f (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] }
2462025-03-22T05:00:28.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35257
2472025-03-22T05:00:28.425ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2482025-03-22T05:00:28.425ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2492025-03-22T05:00:28.425ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2502025-03-22T05:00:28.425ZINFOSledAgent (StorageManager): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2512025-03-22T05:00:28.425ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1302 request = omicron_physical_disks_ensure
2522025-03-22T05:00:28.425ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
2532025-03-22T05:00:28.425ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
2542025-03-22T05:00:28.425ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2552025-03-22T05:00:28.425ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2562025-03-22T05:00:28.556ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2572025-03-22T05:00:28.556ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f282df4c-a498-441e-a714-cfa606ade1c7 (zpool)
2582025-03-22T05:00:28.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2592025-03-22T05:00:28.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2602025-03-22T05:00:28.985ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2612025-03-22T05:00:29.189ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
2622025-03-22T05:00:29.235ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }
2632025-03-22T05:00:29.243ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2642025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2652025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2662025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2672025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2682025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2692025-03-22T05:00:29.244ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2702025-03-22T05:00:29.280ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2712025-03-22T05:00:29.288ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone file = sled-storage/src/dataset.rs:304
2722025-03-22T05:00:29.425ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f282df4c-a498-441e-a714-cfa606ade1c7 file = sled-storage/src/dataset.rs:390
2732025-03-22T05:00:29.434ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:456
2742025-03-22T05:00:29.434ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2752025-03-22T05:00:29.434ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
2762025-03-22T05:00:29.434ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2772025-03-22T05:00:29.434ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2782025-03-22T05:00:29.445ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2792025-03-22T05:00:29.445ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool)
2802025-03-22T05:00:29.541ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }
2812025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2822025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2832025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2842025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2852025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872025-03-22T05:00:29.549ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2882025-03-22T05:00:29.585ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2892025-03-22T05:00:29.593ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/zone file = sled-storage/src/dataset.rs:304
2902025-03-22T05:00:29.732ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b47c4962-4319-408d-9df5-7ff4139e32f5 file = sled-storage/src/dataset.rs:390
2912025-03-22T05:00:29.740ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:456
2922025-03-22T05:00:29.740ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2932025-03-22T05:00:29.740ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
2942025-03-22T05:00:29.740ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2952025-03-22T05:00:29.740ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2962025-03-22T05:00:29.749ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2972025-03-22T05:00:29.749ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool)
2982025-03-22T05:00:29.839ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }
2992025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
3002025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
3012025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3022025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3032025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3042025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3052025-03-22T05:00:29.848ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3062025-03-22T05:00:29.883ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3072025-03-22T05:00:29.891ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone file = sled-storage/src/dataset.rs:304
3082025-03-22T05:00:29.987ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
3092025-03-22T05:00:30.025ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5436dcfe-a58e-4d96-a581-643f03565c69 file = sled-storage/src/dataset.rs:390
3102025-03-22T05:00:30.034ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:456
3112025-03-22T05:00:30.034ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3122025-03-22T05:00:30.034ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
3132025-03-22T05:00:30.034ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3142025-03-22T05:00:30.034ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3152025-03-22T05:00:30.044ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3162025-03-22T05:00:30.044ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 25a954fe-dd77-4935-9929-93fce92615d1 (zpool)
3172025-03-22T05:00:30.141ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }
3182025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3192025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3202025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3212025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3222025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3232025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3242025-03-22T05:00:30.150ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3252025-03-22T05:00:30.184ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262025-03-22T05:00:30.192ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone file = sled-storage/src/dataset.rs:304
3272025-03-22T05:00:30.327ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_25a954fe-dd77-4935-9929-93fce92615d1 file = sled-storage/src/dataset.rs:390
3282025-03-22T05:00:30.335ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:456
3292025-03-22T05:00:30.335ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3302025-03-22T05:00:30.335ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
3312025-03-22T05:00:30.335ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3322025-03-22T05:00:30.335ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3332025-03-22T05:00:30.345ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3342025-03-22T05:00:30.345ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool)
3352025-03-22T05:00:30.442ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }
3362025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3372025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3382025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3392025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3402025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3412025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3422025-03-22T05:00:30.450ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3432025-03-22T05:00:30.486ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442025-03-22T05:00:30.494ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/zone file = sled-storage/src/dataset.rs:304
3452025-03-22T05:00:30.631ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09 file = sled-storage/src/dataset.rs:390
3462025-03-22T05:00:30.639ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:456
3472025-03-22T05:00:30.639ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3482025-03-22T05:00:30.639ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
3492025-03-22T05:00:30.639ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3502025-03-22T05:00:30.639ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3512025-03-22T05:00:30.648ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3522025-03-22T05:00:30.648ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool)
3532025-03-22T05:00:30.741ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }
3542025-03-22T05:00:30.748ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3552025-03-22T05:00:30.748ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3562025-03-22T05:00:30.748ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3572025-03-22T05:00:30.749ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3582025-03-22T05:00:30.749ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3592025-03-22T05:00:30.749ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3602025-03-22T05:00:30.749ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3612025-03-22T05:00:30.784ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3622025-03-22T05:00:30.792ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone file = sled-storage/src/dataset.rs:304
3632025-03-22T05:00:30.932ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 file = sled-storage/src/dataset.rs:390
3642025-03-22T05:00:30.940ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:456
3652025-03-22T05:00:30.940ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3662025-03-22T05:00:30.940ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
3672025-03-22T05:00:30.940ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3682025-03-22T05:00:30.940ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3692025-03-22T05:00:30.950ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3702025-03-22T05:00:30.950ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool)
3712025-03-22T05:00:31.046ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }
3722025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3732025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3742025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3752025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3762025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3772025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3782025-03-22T05:00:31.054ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3792025-03-22T05:00:31.058ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
3802025-03-22T05:00:31.091ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812025-03-22T05:00:31.100ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone file = sled-storage/src/dataset.rs:304
3822025-03-22T05:00:31.242ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7deb16a6-d604-4284-9783-3c07eddc30d2 file = sled-storage/src/dataset.rs:390
3832025-03-22T05:00:31.250ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:456
3842025-03-22T05:00:31.250ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3852025-03-22T05:00:31.250ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
3862025-03-22T05:00:31.250ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3872025-03-22T05:00:31.250ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3882025-03-22T05:00:31.260ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3892025-03-22T05:00:31.260ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool)
3902025-03-22T05:00:31.354ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }
3912025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3922025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3932025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3942025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3952025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3962025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3972025-03-22T05:00:31.362ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3982025-03-22T05:00:31.396ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992025-03-22T05:00:31.404ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone file = sled-storage/src/dataset.rs:304
4002025-03-22T05:00:31.550ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4 file = sled-storage/src/dataset.rs:390
4012025-03-22T05:00:31.559ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:456
4022025-03-22T05:00:31.559ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
4032025-03-22T05:00:31.559ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
4042025-03-22T05:00:31.559ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
4052025-03-22T05:00:31.559ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4062025-03-22T05:00:31.568ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4072025-03-22T05:00:31.568ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool)
4082025-03-22T05:00:31.664ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }
4092025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4102025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4112025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4122025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4132025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4142025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4152025-03-22T05:00:31.672ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4162025-03-22T05:00:31.708ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4172025-03-22T05:00:31.715ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone file = sled-storage/src/dataset.rs:304
4182025-03-22T05:00:31.858ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673 file = sled-storage/src/dataset.rs:390
4192025-03-22T05:00:31.866ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:456
4202025-03-22T05:00:31.866ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4212025-03-22T05:00:31.866ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4222025-03-22T05:00:31.866ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4232025-03-22T05:00:31.866ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4242025-03-22T05:00:31.866ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4252025-03-22T05:00:31.866ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4262025-03-22T05:00:31.866ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4272025-03-22T05:00:31.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4282025-03-22T05:00:31.866ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4292025-03-22T05:00:31.866ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4302025-03-22T05:00:31.866ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4312025-03-22T05:00:31.867ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4322025-03-22T05:00:31.867ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4332025-03-22T05:00:31.867ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4342025-03-22T05:00:31.867ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4352025-03-22T05:00:31.867ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4362025-03-22T05:00:31.867ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(2), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4372025-03-22T05:00:31.867ZINFOSledAgent (StorageManager): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4382025-03-22T05:00:31.867ZINFOSledAgent (StorageManager): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-22T05:00:31.867ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4402025-03-22T05:00:31.882ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4412025-03-22T05:00:31.882ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4422025-03-22T05:00:31.882ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } file = sled-storage/src/manager.rs:1434
4432025-03-22T05:00:31.939ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4442025-03-22T05:00:31.939ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4452025-03-22T05:00:31.939ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crucible" } file = sled-storage/src/manager.rs:1434
4462025-03-22T05:00:31.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4472025-03-22T05:00:31.985ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4482025-03-22T05:00:31.985ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone" } file = sled-storage/src/manager.rs:1434
4492025-03-22T05:00:32.015ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4502025-03-22T05:00:32.015ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4512025-03-22T05:00:32.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } file = sled-storage/src/manager.rs:1434
4522025-03-22T05:00:32.060ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
4532025-03-22T05:00:32.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4542025-03-22T05:00:32.075ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4552025-03-22T05:00:32.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crucible" } file = sled-storage/src/manager.rs:1434
4562025-03-22T05:00:32.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4572025-03-22T05:00:32.122ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4582025-03-22T05:00:32.122ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/debug"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/debug" } file = sled-storage/src/manager.rs:1434
4592025-03-22T05:00:32.150ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4602025-03-22T05:00:32.150ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4612025-03-22T05:00:32.150ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone" } file = sled-storage/src/manager.rs:1434
4622025-03-22T05:00:32.180ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4632025-03-22T05:00:32.180ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4642025-03-22T05:00:32.180ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crucible" } file = sled-storage/src/manager.rs:1434
4652025-03-22T05:00:32.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4662025-03-22T05:00:32.229ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4672025-03-22T05:00:32.229ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } file = sled-storage/src/manager.rs:1434
4682025-03-22T05:00:32.291ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4692025-03-22T05:00:32.291ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4702025-03-22T05:00:32.291ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } file = sled-storage/src/manager.rs:1434
4712025-03-22T05:00:32.348ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-22T05:00:32.348ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4732025-03-22T05:00:32.348ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/debug"), full_name: "oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/debug" } file = sled-storage/src/manager.rs:1434
4742025-03-22T05:00:32.377ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-22T05:00:32.377ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4762025-03-22T05:00:32.377ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } file = sled-storage/src/manager.rs:1434
4772025-03-22T05:00:32.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-22T05:00:32.435ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4792025-03-22T05:00:32.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } file = sled-storage/src/manager.rs:1434
4802025-03-22T05:00:32.495ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4812025-03-22T05:00:32.495ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4822025-03-22T05:00:32.495ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/external_dns" } file = sled-storage/src/manager.rs:1434
4832025-03-22T05:00:32.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4842025-03-22T05:00:32.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4852025-03-22T05:00:32.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
4862025-03-22T05:00:32.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-22T05:00:32.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4882025-03-22T05:00:32.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } file = sled-storage/src/manager.rs:1434
4892025-03-22T05:00:32.654ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-22T05:00:32.654ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4912025-03-22T05:00:32.654ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone" } file = sled-storage/src/manager.rs:1434
4922025-03-22T05:00:32.684ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-22T05:00:32.684ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4942025-03-22T05:00:32.684ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } file = sled-storage/src/manager.rs:1434
4952025-03-22T05:00:32.743ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-22T05:00:32.743ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4972025-03-22T05:00:32.743ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/debug"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/debug" } file = sled-storage/src/manager.rs:1434
4982025-03-22T05:00:32.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4992025-03-22T05:00:32.772ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5002025-03-22T05:00:32.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5012025-03-22T05:00:32.782ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 19.050742315s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
5022025-03-22T05:00:32.820ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5032025-03-22T05:00:32.820ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5042025-03-22T05:00:32.820ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone" } file = sled-storage/src/manager.rs:1434
5052025-03-22T05:00:32.850ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5062025-03-22T05:00:32.851ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5072025-03-22T05:00:32.851ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/debug"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/debug" } file = sled-storage/src/manager.rs:1434
5082025-03-22T05:00:32.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5092025-03-22T05:00:32.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5102025-03-22T05:00:32.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/external_dns" } file = sled-storage/src/manager.rs:1434
5112025-03-22T05:00:32.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5122025-03-22T05:00:32.928ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5132025-03-22T05:00:32.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/debug"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/debug" } file = sled-storage/src/manager.rs:1434
5142025-03-22T05:00:32.958ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5152025-03-22T05:00:32.958ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5162025-03-22T05:00:32.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } file = sled-storage/src/manager.rs:1434
5172025-03-22T05:00:33.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5182025-03-22T05:00:33.018ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5192025-03-22T05:00:33.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } file = sled-storage/src/manager.rs:1434
5202025-03-22T05:00:33.062ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
5212025-03-22T05:00:33.080ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5222025-03-22T05:00:33.080ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5232025-03-22T05:00:33.080ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone" } file = sled-storage/src/manager.rs:1434
5242025-03-22T05:00:33.109ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5252025-03-22T05:00:33.109ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5262025-03-22T05:00:33.109ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5272025-03-22T05:00:33.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5282025-03-22T05:00:33.159ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5292025-03-22T05:00:33.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crucible" } file = sled-storage/src/manager.rs:1434
5302025-03-22T05:00:33.207ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5312025-03-22T05:00:33.207ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5322025-03-22T05:00:33.207ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } file = sled-storage/src/manager.rs:1434
5332025-03-22T05:00:33.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5342025-03-22T05:00:33.268ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5352025-03-22T05:00:33.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone/oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone/oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } file = sled-storage/src/manager.rs:1434
5362025-03-22T05:00:33.329ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5372025-03-22T05:00:33.329ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5382025-03-22T05:00:33.329ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crucible" } file = sled-storage/src/manager.rs:1434
5392025-03-22T05:00:33.376ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5402025-03-22T05:00:33.376ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5412025-03-22T05:00:33.376ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5422025-03-22T05:00:33.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5432025-03-22T05:00:33.425ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5442025-03-22T05:00:33.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } file = sled-storage/src/manager.rs:1434
5452025-03-22T05:00:33.489ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5462025-03-22T05:00:33.489ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5472025-03-22T05:00:33.489ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_crucible_115623d2-4836-4646-926b-554a07875001"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_crucible_115623d2-4836-4646-926b-554a07875001" } file = sled-storage/src/manager.rs:1434
5482025-03-22T05:00:33.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5492025-03-22T05:00:33.549ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5502025-03-22T05:00:33.549ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } file = sled-storage/src/manager.rs:1434
5512025-03-22T05:00:33.609ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5522025-03-22T05:00:33.609ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5532025-03-22T05:00:33.609ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/zone/oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5"), full_name: "oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/zone/oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } file = sled-storage/src/manager.rs:1434
5542025-03-22T05:00:33.667ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5552025-03-22T05:00:33.667ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5562025-03-22T05:00:33.667ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/zone/oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } file = sled-storage/src/manager.rs:1434
5572025-03-22T05:00:33.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5582025-03-22T05:00:33.726ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5592025-03-22T05:00:33.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crucible" } file = sled-storage/src/manager.rs:1434
5602025-03-22T05:00:33.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5612025-03-22T05:00:33.773ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5622025-03-22T05:00:33.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
5632025-03-22T05:00:33.821ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5642025-03-22T05:00:33.822ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5652025-03-22T05:00:33.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } file = sled-storage/src/manager.rs:1434
5662025-03-22T05:00:33.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5672025-03-22T05:00:33.880ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5682025-03-22T05:00:33.880ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } file = sled-storage/src/manager.rs:1434
5692025-03-22T05:00:33.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5702025-03-22T05:00:33.944ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5712025-03-22T05:00:33.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/zone"), full_name: "oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/zone" } file = sled-storage/src/manager.rs:1434
5722025-03-22T05:00:33.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5732025-03-22T05:00:33.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5742025-03-22T05:00:33.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crucible" } file = sled-storage/src/manager.rs:1434
5752025-03-22T05:00:34.020ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5762025-03-22T05:00:34.020ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5772025-03-22T05:00:34.020ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone"), full_name: "oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone" } file = sled-storage/src/manager.rs:1434
5782025-03-22T05:00:34.048ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5792025-03-22T05:00:34.049ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5802025-03-22T05:00:34.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crucible" } file = sled-storage/src/manager.rs:1434
5812025-03-22T05:00:34.065ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
5822025-03-22T05:00:34.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5832025-03-22T05:00:34.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5842025-03-22T05:00:34.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone/oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df"), full_name: "oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone/oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } file = sled-storage/src/manager.rs:1434
5852025-03-22T05:00:34.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5862025-03-22T05:00:34.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5872025-03-22T05:00:34.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone/oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d"), full_name: "oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/zone/oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } file = sled-storage/src/manager.rs:1434
5882025-03-22T05:00:34.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5892025-03-22T05:00:34.216ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5902025-03-22T05:00:34.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5912025-03-22T05:00:34.265ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5922025-03-22T05:00:34.265ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5932025-03-22T05:00:34.265ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } file = sled-storage/src/manager.rs:1434
5942025-03-22T05:00:34.324ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5952025-03-22T05:00:34.324ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5962025-03-22T05:00:34.324ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/zone"), full_name: "oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/zone" } file = sled-storage/src/manager.rs:1434
5972025-03-22T05:00:34.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5982025-03-22T05:00:34.353ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5992025-03-22T05:00:34.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone" } file = sled-storage/src/manager.rs:1434
6002025-03-22T05:00:34.381ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6012025-03-22T05:00:34.381ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6022025-03-22T05:00:34.381ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/debug"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/debug" } file = sled-storage/src/manager.rs:1434
6032025-03-22T05:00:34.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6042025-03-22T05:00:34.409ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6052025-03-22T05:00:34.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
6062025-03-22T05:00:34.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6072025-03-22T05:00:34.459ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6082025-03-22T05:00:34.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/zone/oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } file = sled-storage/src/manager.rs:1434
6092025-03-22T05:00:34.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6102025-03-22T05:00:34.519ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6112025-03-22T05:00:34.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/debug"), full_name: "oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/debug" } file = sled-storage/src/manager.rs:1434
6122025-03-22T05:00:34.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6132025-03-22T05:00:34.549ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6142025-03-22T05:00:34.549ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/debug"), full_name: "oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crypt/debug" } file = sled-storage/src/manager.rs:1434
6152025-03-22T05:00:34.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6162025-03-22T05:00:34.578ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6172025-03-22T05:00:34.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crucible" } file = sled-storage/src/manager.rs:1434
6182025-03-22T05:00:34.625ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6192025-03-22T05:00:34.626ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6202025-03-22T05:00:34.626ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/zone/oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa"), full_name: "oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/zone/oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } file = sled-storage/src/manager.rs:1434
6212025-03-22T05:00:34.686ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6222025-03-22T05:00:34.687ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6232025-03-22T05:00:34.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone/oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad"), full_name: "oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/zone/oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } file = sled-storage/src/manager.rs:1434
6242025-03-22T05:00:34.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6252025-03-22T05:00:34.747ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6262025-03-22T05:00:34.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), full_name: "oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/zone/oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } file = sled-storage/src/manager.rs:1434
6272025-03-22T05:00:34.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6282025-03-22T05:00:34.807ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6292025-03-22T05:00:34.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/clickhouse" } file = sled-storage/src/manager.rs:1434
6302025-03-22T05:00:34.856ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6312025-03-22T05:00:34.856ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6322025-03-22T05:00:34.856ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
6332025-03-22T05:00:34.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6342025-03-22T05:00:34.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6352025-03-22T05:00:34.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25"), full_name: "oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crypt/zone/oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } file = sled-storage/src/manager.rs:1434
6362025-03-22T05:00:34.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6372025-03-22T05:00:34.964ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6382025-03-22T05:00:34.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/debug"), full_name: "oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/debug" } file = sled-storage/src/manager.rs:1434
6392025-03-22T05:00:34.993ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6402025-03-22T05:00:34.993ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6412025-03-22T05:00:34.993ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965"), full_name: "oxp_25a954fe-dd77-4935-9929-93fce92615d1/crypt/zone/oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } file = sled-storage/src/manager.rs:1434
6422025-03-22T05:00:35.052ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6432025-03-22T05:00:35.053ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6442025-03-22T05:00:35.053ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
6452025-03-22T05:00:35.053ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6462025-03-22T05:00:35.053ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6472025-03-22T05:00:35.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6482025-03-22T05:00:35.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6492025-03-22T05:00:35.067ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
6502025-03-22T05:00:35.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6512025-03-22T05:00:35.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-03-22T05:00:35.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6532025-03-22T05:00:35.079ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:186
6542025-03-22T05:00:35.079ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:186
6552025-03-22T05:00:35.079ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6562025-03-22T05:00:35.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6572025-03-22T05:00:35.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6582025-03-22T05:00:35.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6592025-03-22T05:00:35.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6602025-03-22T05:00:35.175ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5 file = illumos-utils/src/zone.rs:356
6612025-03-22T05:00:35.179ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f file = illumos-utils/src/zone.rs:356
6622025-03-22T05:00:35.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239 file = illumos-utils/src/zone.rs:356
6632025-03-22T05:00:35.194ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5 file = illumos-utils/src/zone.rs:394
6642025-03-22T05:00:35.199ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f file = illumos-utils/src/zone.rs:394
6652025-03-22T05:00:35.203ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239 file = illumos-utils/src/zone.rs:394
6662025-03-22T05:00:36.069ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
6672025-03-22T05:00:36.914ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6682025-03-22T05:00:36.914ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
6692025-03-22T05:00:36.914ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
6702025-03-22T05:00:36.920ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }]
6712025-03-22T05:00:36.920ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
6722025-03-22T05:00:37.401ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732025-03-22T05:00:37.870ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
6742025-03-22T05:00:37.870ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
6752025-03-22T05:00:37.881ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762025-03-22T05:00:37.881ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
6772025-03-22T05:00:37.885ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
6782025-03-22T05:00:37.885ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
6792025-03-22T05:00:37.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 45.312661ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
6802025-03-22T05:00:37.889ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
6812025-03-22T05:00:37.893ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
6822025-03-22T05:00:37.945ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 109.012823ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
6832025-03-22T05:00:38.016ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4426
6842025-03-22T05:00:38.016ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4436 gateway = fd00:1122:3344:101::1
6852025-03-22T05:00:38.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 53.929497ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
6862025-03-22T05:00:38.025ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4450 gateway = fd00:1122:3344:101::1
6872025-03-22T05:00:38.025ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4515
6882025-03-22T05:00:38.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 47.277367ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
6892025-03-22T05:00:38.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 267.072363ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
6902025-03-22T05:00:38.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 66.583982ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
6912025-03-22T05:00:38.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 58.896148ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
6922025-03-22T05:00:38.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 136.473447ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
6932025-03-22T05:00:38.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 142.68498ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
6942025-03-22T05:00:38.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 568.426451ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
6952025-03-22T05:00:38.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 434.745554ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
6962025-03-22T05:00:38.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 352.559574ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
6972025-03-22T05:00:38.502ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4556
6982025-03-22T05:00:38.502ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4589
6992025-03-22T05:00:38.573ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4602
7002025-03-22T05:00:38.573ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4467
7012025-03-22T05:00:38.641ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4509
7022025-03-22T05:00:38.641ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4566 rack_subnet = fd00:1122:3344::
7032025-03-22T05:00:38.664ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4577
7042025-03-22T05:00:38.664ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4659
7052025-03-22T05:00:38.745ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4691
7062025-03-22T05:00:38.745ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4697
7072025-03-22T05:00:38.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 542.187202ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7082025-03-22T05:00:38.829ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 822.054169ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7092025-03-22T05:00:38.838ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4738
7102025-03-22T05:00:38.838ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4608
7112025-03-22T05:00:38.938ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4641
7122025-03-22T05:00:38.938ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7132025-03-22T05:00:38.939ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 785.032326ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
7142025-03-22T05:00:38.972ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/nexus.rs:530 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
7152025-03-22T05:00:38.973ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7162025-03-22T05:00:38.986ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
7172025-03-22T05:00:38.986ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
7182025-03-22T05:00:39.004ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7192025-03-22T05:00:39.005ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7202025-03-22T05:00:39.005ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7212025-03-22T05:00:39.005ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7222025-03-22T05:00:39.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
7232025-03-22T05:00:39.094ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7242025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452025-03-22T05:00:39.094ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-03-22T05:00:39.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 1.30403704s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7472025-03-22T05:00:39.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 513.346482ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7482025-03-22T05:00:39.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 1.380448142s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
7492025-03-22T05:00:40.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 1.056891447s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7502025-03-22T05:00:40.686ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 650.994791ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7512025-03-22T05:00:41.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 501.088493ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
7522025-03-22T05:00:41.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 629.92598ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7532025-03-22T05:00:41.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 613.599006ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7542025-03-22T05:00:41.635ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5") failed: Property not found. retry in 1.393007622s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
7552025-03-22T05:00:41.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 831.719327ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7562025-03-22T05:00:41.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239") failed: Property not found. retry in 1.093989706s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7572025-03-22T05:00:42.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f") failed: Property not found. retry in 1.360278534s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7582025-03-22T05:00:43.975ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/nexus.rs:530 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
7592025-03-22T05:00:44.118ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5
7602025-03-22T05:00:44.118ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f
7612025-03-22T05:00:44.118ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239
7622025-03-22T05:00:44.118ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7632025-03-22T05:00:44.118ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7642025-03-22T05:00:44.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 15694431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35257 req_id = 9ec7941e-d0f7-4094-81bc-cfcc80dc4e3a response_code = 200 uri = /omicron-config
7652025-03-22T05:00:44.121ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7662025-03-22T05:00:44.168ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7672025-03-22T05:00:44.221ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7682025-03-22T05:00:44.268ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:642
7692025-03-22T05:00:44.268ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7702025-03-22T05:00:44.300ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7712025-03-22T05:00:44.301ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7722025-03-22T05:00:44.301ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7732025-03-22T05:00:44.330ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(3), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(3), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 47dabbcc-ec67-4cf5-9fdc-e29896133239 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: e268e517-be89-4885-8e3a-f954a2bf9ab5 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eca08ebf-6363-457d-ac26-a0e32f33ca2f (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 (service), filesystem_pool: Some(ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d7ebcd1b-6e68-40c2-a0c6-f49da0e31272, kind: Service { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 }, name: Name("ntp-16b1d962-d659-4a4f-ad69-05dd69c8b696"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] }
7742025-03-22T05:00:44.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39246
7752025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
7762025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(3), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
7772025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
7782025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
7792025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
7802025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
7812025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
7822025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
7832025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
7842025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
7852025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
7862025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
7872025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
7882025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
7892025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
7902025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
7912025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
7922025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
7932025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
7942025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
7952025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
7962025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
7972025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
7982025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
7992025-03-22T05:00:44.331ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
8002025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
8012025-03-22T05:00:44.331ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(3), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
8022025-03-22T05:00:44.331ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
8032025-03-22T05:00:44.331ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
8042025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
8052025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8062025-03-22T05:00:44.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8072025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(3) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8082025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8092025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8102025-03-22T05:00:44.331ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(3) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8112025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8122025-03-22T05:00:44.331ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(3)
8132025-03-22T05:00:44.331ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8142025-03-22T05:00:44.331ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
8152025-03-22T05:00:44.332ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(3), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
8162025-03-22T05:00:44.332ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
8172025-03-22T05:00:44.332ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
8182025-03-22T05:00:44.332ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
8192025-03-22T05:00:44.332ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(2) request = datasets_ensure requested_generation = Generation(3)
8202025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8212025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8222025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8232025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8242025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8252025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8262025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8272025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8282025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8292025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8302025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8312025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8322025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8332025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8342025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8352025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8362025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8372025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8382025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8392025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8402025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8412025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8422025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8432025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8442025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8452025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8462025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8472025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8482025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8492025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8502025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8512025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8522025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8532025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8542025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8552025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8562025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8572025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8582025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8592025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8602025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8612025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8622025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8632025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8642025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8652025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8662025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8672025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8682025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8692025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8702025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8712025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8722025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8732025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8742025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8752025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8762025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8772025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8782025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8792025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8802025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8812025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8822025-03-22T05:00:44.361ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8832025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8842025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8852025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8862025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8872025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8882025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8892025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8902025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8912025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8922025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8932025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8942025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8952025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8962025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8972025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8982025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8992025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9002025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9012025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9022025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9032025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9042025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9052025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9062025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9072025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9082025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9092025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9102025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9112025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9122025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9132025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9142025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9152025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9162025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9172025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9182025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9192025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9202025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9212025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9222025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9232025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9242025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9252025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9262025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9272025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9282025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9292025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9302025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9312025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9322025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9332025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9342025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9352025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9362025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9372025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9382025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9392025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9402025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9412025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9422025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9432025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9442025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9452025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9462025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9472025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9482025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9492025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9502025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9512025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9522025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9532025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9542025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9552025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9562025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9572025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9582025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9592025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9602025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9612025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9622025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9632025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9642025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9652025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9662025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9672025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9682025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9692025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9702025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9712025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9722025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9732025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9742025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9752025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9762025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9772025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
9782025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9792025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9802025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9812025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9822025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9832025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9842025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9852025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9862025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
9872025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9882025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9892025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
9902025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9912025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9922025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9932025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9942025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9952025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9962025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9972025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9982025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9992025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10002025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10012025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10022025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10032025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10042025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10052025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10062025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10072025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10082025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10092025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10102025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10112025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10122025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10132025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
10142025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10152025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10162025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10172025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10182025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
10192025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
10202025-03-22T05:00:44.362ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10212025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10222025-03-22T05:00:44.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232025-03-22T05:00:44.373ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10242025-03-22T05:00:44.374ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10252025-03-22T05:00:44.384ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10262025-03-22T05:00:44.384ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10272025-03-22T05:00:44.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10282025-03-22T05:00:44.393ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
10292025-03-22T05:00:44.393ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
10302025-03-22T05:00:44.394ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
10312025-03-22T05:00:44.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10322025-03-22T05:00:44.405ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10332025-03-22T05:00:44.438ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10342025-03-22T05:00:44.438ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10352025-03-22T05:00:44.438ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10362025-03-22T05:00:44.468ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 229, 89]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
10372025-03-22T05:00:44.468ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = boundary_ntp
10382025-03-22T05:00:44.468ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
10392025-03-22T05:00:44.468ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
10402025-03-22T05:00:44.469ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
10412025-03-22T05:00:44.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10422025-03-22T05:00:44.493ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696 file = illumos-utils/src/zone.rs:356
10432025-03-22T05:00:44.511ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696 file = illumos-utils/src/zone.rs:394
10442025-03-22T05:00:45.240ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10452025-03-22T05:00:45.241ZINFOSledAgent (ServiceManager): Booting oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10462025-03-22T05:00:45.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 46.852734ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10472025-03-22T05:00:45.433ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 91.934949ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10482025-03-22T05:00:45.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 195.022603ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10492025-03-22T05:00:45.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 567.65752ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10502025-03-22T05:00:46.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 445.178979ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10512025-03-22T05:00:46.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 1.195240512s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10522025-03-22T05:00:47.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10532025-03-22T05:00:47.872ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10542025-03-22T05:00:47.978ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 1.034381097s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10552025-03-22T05:00:48.988ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10562025-03-22T05:00:48.988ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10572025-03-22T05:00:49.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 827.380725ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10582025-03-22T05:00:49.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696") failed: Property not found. retry in 880.088826ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10592025-03-22T05:00:50.759ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696
10602025-03-22T05:00:50.759ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10612025-03-22T05:00:50.760ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10622025-03-22T05:00:50.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6429726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39246 req_id = 32a22141-ce08-4b26-b053-e8df700c35d2 response_code = 200 uri = /omicron-config
10632025-03-22T05:00:50.762ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:683
10642025-03-22T05:00:50.792ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10652025-03-22T05:00:50.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44074
10662025-03-22T05:00:50.801ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10672025-03-22T05:00:50.801ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44074 req_id = 11cd18a1-a437-4792-b387-777c6f294fd4 response_code = 500 uri = /timesync
10682025-03-22T05:00:50.804ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10692025-03-22T05:00:50.939ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10702025-03-22T05:00:50.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62666
10712025-03-22T05:00:54.948ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10722025-03-22T05:00:54.948ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008448 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62666 req_id = 0985cc8d-afc6-4346-a77b-9a0428761523 response_code = 500 uri = /timesync
10732025-03-22T05:00:54.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10742025-03-22T05:00:54.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10752025-03-22T05:00:54.950ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10762025-03-22T05:00:54.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10772025-03-22T05:00:55.130ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10782025-03-22T05:00:55.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40882
10792025-03-22T05:00:55.139ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10802025-03-22T05:00:55.139ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 9429 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40882 req_id = f5d7cf2f-8bb4-4eb3-87de-806aec3c8e7a response_code = 500 uri = /timesync
10812025-03-22T05:00:55.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10822025-03-22T05:00:55.293ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10832025-03-22T05:00:55.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54230
10842025-03-22T05:00:59.659ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10852025-03-22T05:00:59.659ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54230 req_id = e7b672d4-26bf-42d7-bf28-2a2453ac1a6c response_code = 500 uri = /timesync
10862025-03-22T05:00:59.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10872025-03-22T05:00:59.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10882025-03-22T05:00:59.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10892025-03-22T05:00:59.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
10902025-03-22T05:00:59.662ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10912025-03-22T05:01:00.045ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10922025-03-22T05:01:00.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55208
10932025-03-22T05:01:00.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8783 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55208 req_id = c78d935b-12e7-4452-953b-21ac4bf757c1 response_code = 200 uri = /timesync
10942025-03-22T05:01:00.055ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10952025-03-22T05:01:00.055ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10962025-03-22T05:01:00.205ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10972025-03-22T05:01:00.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35016
10982025-03-22T05:01:00.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35016 req_id = 73c9130e-851c-4bdc-afed-8f37a774301a response_code = 200 uri = /timesync
10992025-03-22T05:01:00.216ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.441013396 } file = sled-agent/src/rack_setup/service.rs:691
11002025-03-22T05:01:00.216ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11012025-03-22T05:01:00.566ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11022025-03-22T05:01:00.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43925
11032025-03-22T05:01:00.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43925 req_id = 6a351d41-4ffe-4e54-bbf4-dfd5bc67532f response_code = 200 uri = /timesync
11042025-03-22T05:01:00.580ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.440024793 } file = sled-agent/src/rack_setup/service.rs:691
11052025-03-22T05:01:00.580ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11062025-03-22T05:01:01.033ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11072025-03-22T05:01:01.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59141
11082025-03-22T05:01:01.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59141 req_id = defd9a35-80e1-4b36-bdfa-f0feddcc3243 response_code = 200 uri = /timesync
11092025-03-22T05:01:01.043ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619660.5384548, correction: -0.43457827 } file = sled-agent/src/rack_setup/service.rs:691
11102025-03-22T05:01:01.043ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11112025-03-22T05:01:01.388ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11122025-03-22T05:01:01.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36581
11132025-03-22T05:01:01.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11142025-03-22T05:01:01.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11152025-03-22T05:01:01.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36581 req_id = 4216d9bc-a7b3-4b12-a9ef-0ad61b0dc88f response_code = 200 uri = /timesync
11162025-03-22T05:01:01.398ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.433612764 } file = sled-agent/src/rack_setup/service.rs:691
11172025-03-22T05:01:01.398ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11182025-03-22T05:01:02.029ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11192025-03-22T05:01:02.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59728
11202025-03-22T05:01:02.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59728 req_id = b658e599-2d9a-453e-a839-69748eb13c9a response_code = 200 uri = /timesync
11212025-03-22T05:01:02.040ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.433707774 } file = sled-agent/src/rack_setup/service.rs:691
11222025-03-22T05:01:02.040ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11232025-03-22T05:01:02.698ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11242025-03-22T05:01:02.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42710
11252025-03-22T05:01:02.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42710 req_id = ab630779-0cff-46bc-8408-086b8bd04a82 response_code = 200 uri = /timesync
11262025-03-22T05:01:02.709ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.431888878 } file = sled-agent/src/rack_setup/service.rs:691
11272025-03-22T05:01:02.709ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11282025-03-22T05:01:03.186ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11292025-03-22T05:01:03.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55325
11302025-03-22T05:01:03.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55325 req_id = 98b074f1-4a1c-4e3e-8155-2109288d4e4f response_code = 200 uri = /timesync
11312025-03-22T05:01:03.196ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.427780449 } file = sled-agent/src/rack_setup/service.rs:691
11322025-03-22T05:01:03.196ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11332025-03-22T05:01:03.612ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11342025-03-22T05:01:03.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57728
11352025-03-22T05:01:03.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57728 req_id = 7303c01f-086c-4822-8bac-5432aaa1ea6a response_code = 200 uri = /timesync
11362025-03-22T05:01:03.622ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.426623672 } file = sled-agent/src/rack_setup/service.rs:691
11372025-03-22T05:01:03.622ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11382025-03-22T05:01:04.323ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11392025-03-22T05:01:04.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41538
11402025-03-22T05:01:04.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41538 req_id = 84add296-8efa-4435-bc82-7f02672e3aea response_code = 200 uri = /timesync
11412025-03-22T05:01:04.332ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.422680438 } file = sled-agent/src/rack_setup/service.rs:691
11422025-03-22T05:01:04.332ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11432025-03-22T05:01:04.922ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11442025-03-22T05:01:04.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52785
11452025-03-22T05:01:04.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52785 req_id = c8780a39-f34c-43c9-a639-2911056ee6c9 response_code = 200 uri = /timesync
11462025-03-22T05:01:04.934ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742619659.3646626, correction: -0.421051055 } file = sled-agent/src/rack_setup/service.rs:691
11472025-03-22T05:01:04.934ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11482025-03-22T05:01:05.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11492025-03-22T05:01:05.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11502025-03-22T05:01:05.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11512025-03-22T05:01:05.692ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11522025-03-22T05:01:05.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51955
11532025-03-22T05:01:05.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51955 req_id = b9dffa1a-c65a-421d-bbf4-bc135608a34d response_code = 200 uri = /timesync
11542025-03-22T05:01:05.704ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619663.8983247, correction: -0.415672809 } file = sled-agent/src/rack_setup/service.rs:691
11552025-03-22T05:01:05.704ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11562025-03-22T05:01:07.235ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11572025-03-22T05:01:07.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44671
11582025-03-22T05:01:07.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44671 req_id = 53f8772d-f957-4f67-841d-b6684078a3b1 response_code = 200 uri = /timesync
11592025-03-22T05:01:07.246ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619665.8840518, correction: -0.411301702 } file = sled-agent/src/rack_setup/service.rs:691
11602025-03-22T05:01:07.246ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11612025-03-22T05:01:08.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58629
11622025-03-22T05:01:08.928ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58629 req_id = ce0cbdf6-5ebd-49fa-a369-9a23bd464c34 response_code = 200 uri = /baseboard
11632025-03-22T05:01:09.474ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11642025-03-22T05:01:09.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64219
11652025-03-22T05:01:09.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64219 req_id = e4677e91-50fb-47e3-b11b-828f5fac4805 response_code = 200 uri = /timesync
11662025-03-22T05:01:09.484ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619668.3247793, correction: -0.405130595 } file = sled-agent/src/rack_setup/service.rs:691
11672025-03-22T05:01:09.484ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11682025-03-22T05:01:09.881ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11692025-03-22T05:01:09.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11702025-03-22T05:01:09.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11712025-03-22T05:01:09.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11722025-03-22T05:01:10.558ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 268.325359ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11732025-03-22T05:01:11.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11742025-03-22T05:01:11.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11752025-03-22T05:01:12.120ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11762025-03-22T05:01:12.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58066
11772025-03-22T05:01:12.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58066 req_id = 2a14f41e-2a8d-42b3-be29-4a791dd7eab2 response_code = 200 uri = /timesync
11782025-03-22T05:01:12.132ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619670.2859385, correction: -0.398095697 } file = sled-agent/src/rack_setup/service.rs:691
11792025-03-22T05:01:12.132ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11802025-03-22T05:01:14.866ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11812025-03-22T05:01:14.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62416
11822025-03-22T05:01:14.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62416 req_id = 682adb72-db1e-44fc-ac12-69b5751127d4 response_code = 200 uri = /timesync
11832025-03-22T05:01:14.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619673.4342368, correction: -0.390564382 } file = sled-agent/src/rack_setup/service.rs:691
11842025-03-22T05:01:14.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11852025-03-22T05:01:15.514ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11862025-03-22T05:01:15.515ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11872025-03-22T05:01:15.515ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11882025-03-22T05:01:17.106ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
11892025-03-22T05:01:17.107ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
11902025-03-22T05:01:17.107ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
11912025-03-22T05:01:17.107ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
11922025-03-22T05:01:19.156ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11932025-03-22T05:01:19.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64335
11942025-03-22T05:01:19.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64335 req_id = d042fcb9-77ce-44d6-a65e-9f496b195be2 response_code = 200 uri = /timesync
11952025-03-22T05:01:19.168ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619677.5085783, correction: -0.378750622 } file = sled-agent/src/rack_setup/service.rs:691
11962025-03-22T05:01:19.168ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11972025-03-22T05:01:19.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11982025-03-22T05:01:19.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
11992025-03-22T05:01:19.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12002025-03-22T05:01:19.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12012025-03-22T05:01:21.284ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12022025-03-22T05:01:21.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39003
12032025-03-22T05:01:21.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8944 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39003 req_id = 47ca04c3-9f75-4363-83ba-becf22d709de response_code = 200 uri = /timesync
12042025-03-22T05:01:21.295ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619680.5707834, correction: -0.373025268 } file = sled-agent/src/rack_setup/service.rs:691
12052025-03-22T05:01:21.295ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12062025-03-22T05:01:21.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12072025-03-22T05:01:21.343ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12082025-03-22T05:01:23.862ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12092025-03-22T05:01:23.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57937
12102025-03-22T05:01:23.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57937 req_id = 21d2640a-9335-4dc8-9f76-2b2ec8835cd1 response_code = 200 uri = /timesync
12112025-03-22T05:01:23.875ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619681.6799948, correction: -0.365972072 } file = sled-agent/src/rack_setup/service.rs:691
12122025-03-22T05:01:23.875ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12132025-03-22T05:01:25.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12142025-03-22T05:01:25.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12152025-03-22T05:01:25.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12162025-03-22T05:01:25.820ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 682.65042ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12172025-03-22T05:01:28.976ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12182025-03-22T05:01:28.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60076
12192025-03-22T05:01:28.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8954 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60076 req_id = 5157b476-8c50-49c6-94f8-49feb65c0e64 response_code = 200 uri = /timesync
12202025-03-22T05:01:28.987ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619687.284179, correction: -0.352024376 } file = sled-agent/src/rack_setup/service.rs:691
12212025-03-22T05:01:28.987ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12222025-03-22T05:01:29.832ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10520982146769983687 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12232025-03-22T05:01:29.832ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 962326041361482949 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12242025-03-22T05:01:29.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12252025-03-22T05:01:29.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12262025-03-22T05:01:31.318ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12272025-03-22T05:01:31.318ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12282025-03-22T05:01:34.898ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12292025-03-22T05:01:34.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42929
12302025-03-22T05:01:34.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42929 req_id = 0113dcc3-cc6c-40fa-b2bb-5a91d9156b5c response_code = 200 uri = /timesync
12312025-03-22T05:01:34.909ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619693.2664795, correction: -0.33583349 } file = sled-agent/src/rack_setup/service.rs:691
12322025-03-22T05:01:34.909ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12332025-03-22T05:01:35.465ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12342025-03-22T05:01:35.465ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12352025-03-22T05:01:35.465ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12362025-03-22T05:01:38.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47633
12372025-03-22T05:01:38.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47633 req_id = cc253495-8ade-41f8-8a51-5a877e883673 response_code = 200 uri = /baseboard
12382025-03-22T05:01:39.808ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12392025-03-22T05:01:39.808ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12402025-03-22T05:01:41.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12412025-03-22T05:01:41.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12422025-03-22T05:01:41.497ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.131991192s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12432025-03-22T05:01:45.440ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6895865289857484058 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12442025-03-22T05:01:45.441ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 126241016467063929 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12452025-03-22T05:01:45.441ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2648779771509530391 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12462025-03-22T05:01:45.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12472025-03-22T05:01:45.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33400
12482025-03-22T05:01:45.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33400 req_id = 4ec408f4-5cf6-485e-a4ec-0b74d9571e48 response_code = 200 uri = /timesync
12492025-03-22T05:01:45.666ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619702.2279646, correction: -0.306646764 } file = sled-agent/src/rack_setup/service.rs:691
12502025-03-22T05:01:45.666ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12512025-03-22T05:01:49.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12522025-03-22T05:01:49.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12532025-03-22T05:01:51.268ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11082642868078105709 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12542025-03-22T05:01:51.268ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8171955843187857927 reason = Duration(60s) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12552025-03-22T05:01:57.621ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.184709761s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12562025-03-22T05:01:58.755ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12572025-03-22T05:01:58.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52729
12582025-03-22T05:01:58.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52729 req_id = c6bf9b0f-cffc-4e01-b612-17528a7cbdae response_code = 200 uri = /timesync
12592025-03-22T05:01:58.767ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619713.9993536, correction: -0.271074831 } file = sled-agent/src/rack_setup/service.rs:691
12602025-03-22T05:01:58.767ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12612025-03-22T05:01:59.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12622025-03-22T05:01:59.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12632025-03-22T05:02:05.197ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12642025-03-22T05:02:05.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52240
12652025-03-22T05:02:05.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52240 req_id = 9d489640-2ddc-4f89-b993-664878e5f7f3 response_code = 200 uri = /timesync
12662025-03-22T05:02:05.209ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619722.2211533, correction: -0.253878415 } file = sled-agent/src/rack_setup/service.rs:691
12672025-03-22T05:02:05.209ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12682025-03-22T05:02:08.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32865
12692025-03-22T05:02:08.832ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32865 req_id = aaaca259-365a-421c-a98f-285b516225cd response_code = 200 uri = /baseboard
12702025-03-22T05:02:09.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12712025-03-22T05:02:09.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12722025-03-22T05:02:14.794ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.882861172s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12732025-03-22T05:02:16.944ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
12742025-03-22T05:02:16.945ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
12752025-03-22T05:02:16.945ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
12762025-03-22T05:02:16.945ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
12772025-03-22T05:02:19.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12782025-03-22T05:02:19.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12792025-03-22T05:02:20.427ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12802025-03-22T05:02:20.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49400
12812025-03-22T05:02:20.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12053 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49400 req_id = 35b0f3c5-7cb1-46b3-bad8-c9d2b35db473 response_code = 200 uri = /timesync
12822025-03-22T05:02:20.442ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619734.3173802, correction: -0.212559372 } file = sled-agent/src/rack_setup/service.rs:691
12832025-03-22T05:02:20.442ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12842025-03-22T05:02:29.685ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12852025-03-22T05:02:29.685ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12862025-03-22T05:02:35.655ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.180730676s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12872025-03-22T05:02:38.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39265
12882025-03-22T05:02:38.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39265 req_id = ad1a3e81-df90-476e-8da0-fd6470c01fa1 response_code = 200 uri = /baseboard
12892025-03-22T05:02:39.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12902025-03-22T05:02:39.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12912025-03-22T05:02:40.912ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12922025-03-22T05:02:40.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39244
12932025-03-22T05:02:40.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39244 req_id = 64fd591b-47a3-4270-b001-a34ec2b0cd8c response_code = 200 uri = /timesync
12942025-03-22T05:02:40.923ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 3, ref_time: 1742619758.2628715, correction: -0.15700765 } file = sled-agent/src/rack_setup/service.rs:691
12952025-03-22T05:02:40.924ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12962025-03-22T05:02:49.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12972025-03-22T05:02:49.636ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12982025-03-22T05:02:58.808ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 23.457022033s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
12992025-03-22T05:02:59.611ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13002025-03-22T05:02:59.611ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13012025-03-22T05:03:05.874ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
13022025-03-22T05:03:05.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64455
13032025-03-22T05:03:05.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64455 req_id = f2d07a5f-dd26-4f6c-9882-b25a2b5f932c response_code = 200 uri = /timesync
13042025-03-22T05:03:05.887ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3227256350, ip_addr: 192.92.6.30, stratum: 2, ref_time: 1742619783.303743, correction: -0.094837405 } file = sled-agent/src/rack_setup/service.rs:691
13052025-03-22T05:03:05.887ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
13062025-03-22T05:03:08.735ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48863
13072025-03-22T05:03:08.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48863 req_id = 40a3eaf6-6950-4360-a4e6-d84225db57e5 response_code = 200 uri = /baseboard
13082025-03-22T05:03:09.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13092025-03-22T05:03:09.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13102025-03-22T05:03:16.783ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
13112025-03-22T05:03:16.783ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
13122025-03-22T05:03:16.783ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
13132025-03-22T05:03:16.783ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
13142025-03-22T05:03:19.560ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16471382844754193825 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13152025-03-22T05:03:19.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6632567285784489353 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13162025-03-22T05:03:26.473ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
13172025-03-22T05:03:26.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41525
13182025-03-22T05:03:26.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41525 req_id = 309761d6-1bc2-46eb-a12d-d139295227f1 response_code = 200 uri = /timesync
13192025-03-22T05:03:26.496ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:45.441311190Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2648779771509530391 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13202025-03-22T05:03:26.497ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:51.268066618Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11082642868078105709 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13212025-03-22T05:03:26.498ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:45.440793141Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6895865289857484058 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13222025-03-22T05:03:26.498ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:29.832933164Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 962326041361482949 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13232025-03-22T05:03:26.498ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:45.441116116Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 126241016467063929 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13242025-03-22T05:03:26.498ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:29.832357153Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10520982146769983687 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13252025-03-22T05:03:26.499ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-22T05:01:51.268407874Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8171955843187857927 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13262025-03-22T05:03:26.500ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3227256350, ip_addr: 192.92.6.30, stratum: 2, ref_time: 1742619805.51283, correction: -0.038976654 } file = sled-agent/src/rack_setup/service.rs:691
13272025-03-22T05:03:26.500ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1327
13282025-03-22T05:03:26.530ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(4), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(4), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 47dabbcc-ec67-4cf5-9fdc-e29896133239 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: e268e517-be89-4885-8e3a-f954a2bf9ab5 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eca08ebf-6363-457d-ac26-a0e32f33ca2f (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 (service), filesystem_pool: Some(ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d7ebcd1b-6e68-40c2-a0c6-f49da0e31272, kind: Service { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 }, name: Name("ntp-16b1d962-d659-4a4f-ad69-05dd69c8b696"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 202b0804-dd28-4e04-88ff-fd30c67affee (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 370a59f1-1551-4b12-84f1-9dea8a286620 (service), filesystem_pool: Some(ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9ebef05b-5a4b-4917-8872-0eb615f55577 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: da3db068-4141-4da6-8520-7d46111d592a (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693 (service), filesystem_pool: Some(ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } } }, image_source: InstallDataset }] }
13292025-03-22T05:03:26.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54938
13302025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13312025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(4), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
13322025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
13332025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
13342025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
13352025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
13362025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
13372025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
13382025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
13392025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
13402025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
13412025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
13422025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
13432025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
13442025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
13452025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
13462025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
13472025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
13482025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
13492025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
13502025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
13512025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
13522025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
13532025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
13542025-03-22T05:03:26.531ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
13552025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
13562025-03-22T05:03:26.531ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(4), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
13572025-03-22T05:03:26.531ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
13582025-03-22T05:03:26.531ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
13592025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
13602025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13612025-03-22T05:03:26.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13622025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(4) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13632025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13642025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13652025-03-22T05:03:26.531ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(4) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13662025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13672025-03-22T05:03:26.531ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(4)
13682025-03-22T05:03:26.531ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13692025-03-22T05:03:26.531ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
13702025-03-22T05:03:26.532ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(4), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
13712025-03-22T05:03:26.532ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
13722025-03-22T05:03:26.532ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
13732025-03-22T05:03:26.532ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
13742025-03-22T05:03:26.532ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(3) request = datasets_ensure requested_generation = Generation(4)
13752025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13762025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13772025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13782025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13792025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13802025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13812025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13822025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13832025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13842025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13852025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13862025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13872025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13882025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13892025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13902025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13912025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
13922025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13932025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13942025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13952025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13962025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13972025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13982025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13992025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14002025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14012025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14022025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14032025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14042025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14052025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14062025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14072025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14082025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14092025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14102025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14112025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14122025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14132025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14142025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14152025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14162025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14172025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14182025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14192025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14202025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14212025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14222025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14232025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14242025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14252025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14262025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14272025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14282025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14292025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14302025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14312025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14322025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14332025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14342025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14352025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14362025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14372025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14382025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14392025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14402025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14412025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14422025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14432025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14442025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14452025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14462025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14472025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14482025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14492025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14502025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14512025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14522025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14532025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14542025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14552025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14562025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14572025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14582025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14592025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14602025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14612025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14622025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14632025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14642025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14652025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14662025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14672025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14682025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14692025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14702025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14712025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14722025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14732025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14742025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14752025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14762025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14772025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14782025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14792025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14802025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14812025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14822025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14832025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14842025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14852025-03-22T05:03:26.562ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14862025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14872025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14882025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14892025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14902025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14912025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14922025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14932025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14942025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14952025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14962025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14972025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14982025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14992025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15002025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15012025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15022025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15032025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15042025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15052025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15062025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15072025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15082025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15092025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15102025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15112025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15122025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15132025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15142025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15152025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15162025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15172025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15182025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15192025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15202025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15212025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15222025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15232025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15242025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15252025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15262025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15272025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15282025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15292025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15302025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15312025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15322025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
15332025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15342025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15352025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15362025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15372025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15382025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15392025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15402025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15412025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
15422025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15432025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15442025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
15452025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15462025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15472025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15482025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15492025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15502025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15512025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15522025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15532025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15542025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15552025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15562025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15572025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15582025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15592025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15602025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15612025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15622025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15632025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15642025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15652025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15662025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15672025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15682025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
15692025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15702025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15712025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15722025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15732025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
15742025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
15752025-03-22T05:03:26.563ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
15762025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15772025-03-22T05:03:26.563ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
15782025-03-22T05:03:26.574ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15792025-03-22T05:03:26.574ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
15802025-03-22T05:03:26.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15812025-03-22T05:03:26.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
15822025-03-22T05:03:26.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15832025-03-22T05:03:26.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15842025-03-22T05:03:26.602ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15852025-03-22T05:03:26.602ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15862025-03-22T05:03:26.612ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15872025-03-22T05:03:26.612ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15882025-03-22T05:03:26.621ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15892025-03-22T05:03:26.621ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15902025-03-22T05:03:26.630ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15912025-03-22T05:03:26.630ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15922025-03-22T05:03:26.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15932025-03-22T05:03:26.639ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
15942025-03-22T05:03:26.640ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
15952025-03-22T05:03:26.640ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
15962025-03-22T05:03:26.640ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15972025-03-22T05:03:26.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15982025-03-22T05:03:26.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15992025-03-22T05:03:26.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16002025-03-22T05:03:26.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16012025-03-22T05:03:26.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16022025-03-22T05:03:26.820ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620 file = illumos-utils/src/zone.rs:356
16032025-03-22T05:03:26.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee file = illumos-utils/src/zone.rs:356
16042025-03-22T05:03:26.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a file = illumos-utils/src/zone.rs:356
16052025-03-22T05:03:26.834ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693 file = illumos-utils/src/zone.rs:356
16062025-03-22T05:03:26.840ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577 file = illumos-utils/src/zone.rs:356
16072025-03-22T05:03:26.845ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620 file = illumos-utils/src/zone.rs:394
16082025-03-22T05:03:26.850ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee file = illumos-utils/src/zone.rs:394
16092025-03-22T05:03:26.855ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a file = illumos-utils/src/zone.rs:394
16102025-03-22T05:03:26.859ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693 file = illumos-utils/src/zone.rs:394
16112025-03-22T05:03:26.864ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577 file = illumos-utils/src/zone.rs:394
16122025-03-22T05:03:30.639ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9ebef05b-5a4b-4917-8872-0eb615f55577'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16132025-03-22T05:03:30.640ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16142025-03-22T05:03:30.660ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='370a59f1-1551-4b12-84f1-9dea8a286620'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16152025-03-22T05:03:30.661ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16162025-03-22T05:03:30.680ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='202b0804-dd28-4e04-88ff-fd30c67affee'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16172025-03-22T05:03:30.680ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16182025-03-22T05:03:30.699ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='da3db068-4141-4da6-8520-7d46111d592a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16192025-03-22T05:03:30.699ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16202025-03-22T05:03:31.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 32.615676ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16212025-03-22T05:03:31.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 83.830029ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16222025-03-22T05:03:31.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 28.39063ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16232025-03-22T05:03:31.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 64.888607ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16242025-03-22T05:03:31.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 71.989481ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16252025-03-22T05:03:31.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 79.042275ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16262025-03-22T05:03:31.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 248.269269ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16272025-03-22T05:03:31.267ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 117.896424ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16282025-03-22T05:03:31.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 105.139368ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16292025-03-22T05:03:31.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 163.401787ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16302025-03-22T05:03:31.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 184.829396ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16312025-03-22T05:03:31.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 226.335034ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16322025-03-22T05:03:31.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 482.505983ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16332025-03-22T05:03:31.496ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16342025-03-22T05:03:31.497ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16352025-03-22T05:03:31.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 365.285999ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16362025-03-22T05:03:31.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 552.60735ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16372025-03-22T05:03:31.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 568.554885ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16382025-03-22T05:03:31.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 59.924988ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16392025-03-22T05:03:31.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 92.161992ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16402025-03-22T05:03:31.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 294.215211ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16412025-03-22T05:03:31.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 507.099419ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16422025-03-22T05:03:31.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 820.470204ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16432025-03-22T05:03:32.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 1.030826993s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16442025-03-22T05:03:32.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 335.673885ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16452025-03-22T05:03:32.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 932.6287ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16462025-03-22T05:03:32.422ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 512.455236ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16472025-03-22T05:03:32.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 1.019526145s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16482025-03-22T05:03:32.817ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 1.267109029s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16492025-03-22T05:03:32.942ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 1.234999929s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16502025-03-22T05:03:33.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 567.718554ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16512025-03-22T05:03:33.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 1.332145462s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16522025-03-22T05:03:33.574ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 704.639814ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16532025-03-22T05:03:33.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 700.032197ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16542025-03-22T05:03:34.088ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 1.281270309s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16552025-03-22T05:03:34.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 1.321039938s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16562025-03-22T05:03:34.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 852.347036ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16572025-03-22T05:03:34.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 1.230621759s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16582025-03-22T05:03:34.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 1.092924383s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16592025-03-22T05:03:35.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 723.141022ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16602025-03-22T05:03:35.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 717.573006ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16612025-03-22T05:03:35.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 1.235802282s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16622025-03-22T05:03:35.645ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 957.159023ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16632025-03-22T05:03:35.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 1.030824551s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16642025-03-22T05:03:35.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 641.514306ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16652025-03-22T05:03:36.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 1.164931576s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16662025-03-22T05:03:36.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 567.452702ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16672025-03-22T05:03:36.610ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 1.385124499s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16682025-03-22T05:03:36.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 500.233295ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16692025-03-22T05:03:36.871ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 609.592218ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16702025-03-22T05:03:37.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 1.484861618s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16712025-03-22T05:03:37.197ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 33.789163593s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
16722025-03-22T05:03:37.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 768.33146ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16732025-03-22T05:03:37.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 1.406771982s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16742025-03-22T05:03:37.488ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 975.454401ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16752025-03-22T05:03:38.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 653.067546ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16762025-03-22T05:03:38.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 709.642777ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16772025-03-22T05:03:38.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 593.629672ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16782025-03-22T05:03:38.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 1.211403208s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16792025-03-22T05:03:38.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 616.285826ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16802025-03-22T05:03:38.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620") failed: Property not found. retry in 1.435222277s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16812025-03-22T05:03:38.687ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38758
16822025-03-22T05:03:38.687ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38758 req_id = 4975f980-5215-4b11-b98d-faec22267500 response_code = 200 uri = /baseboard
16832025-03-22T05:03:38.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee") failed: Property not found. retry in 1.499864506s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16842025-03-22T05:03:39.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577") failed: Property not found. retry in 969.988544ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16852025-03-22T05:03:39.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a") failed: Property not found. retry in 1.122587602s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16862025-03-22T05:03:39.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693") failed: Property not found. retry in 929.968961ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16872025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620
16882025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee
16892025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a
16902025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693
16912025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577
16922025-03-22T05:03:40.801ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
16932025-03-22T05:03:40.802ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
16942025-03-22T05:03:40.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 14310990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54938 req_id = 4728ed88-b75c-4ce8-bbdd-76b1930b932a response_code = 200 uri = /omicron-config
16952025-03-22T05:03:40.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33674
16962025-03-22T05:03:40.869ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 31248 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = 5ee8adc7-077a-4631-bd37-04f38f9cc7b1 response_code = 500 uri = /cockroachdb
16972025-03-22T05:03:40.869ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5ee8adc7-077a-4631-bd37-04f38f9cc7b1", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5ee8adc7-077a-4631-bd37-04f38f9cc7b1" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 60.440463ms
16982025-03-22T05:03:40.960ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = 064183b1-b7e9-460c-b501-43a15eda85d7 response_code = 500 uri = /cockroachdb
16992025-03-22T05:03:40.960ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "064183b1-b7e9-460c-b501-43a15eda85d7", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "064183b1-b7e9-460c-b501-43a15eda85d7" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 159.507063ms
17002025-03-22T05:03:41.149ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = 6e40703a-00b3-42b6-8571-6f64bc0cea67 response_code = 500 uri = /cockroachdb
17012025-03-22T05:03:41.149ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e40703a-00b3-42b6-8571-6f64bc0cea67", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e40703a-00b3-42b6-8571-6f64bc0cea67" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 97.450032ms
17022025-03-22T05:03:41.277ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28485 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = eb7d3d2f-6960-4463-866e-73fada587244 response_code = 500 uri = /cockroachdb
17032025-03-22T05:03:41.277ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "eb7d3d2f-6960-4463-866e-73fada587244", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "eb7d3d2f-6960-4463-866e-73fada587244" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 205.537586ms
17042025-03-22T05:03:41.511ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = d363eaa5-b117-4712-b981-9dd061b0f2d9 response_code = 500 uri = /cockroachdb
17052025-03-22T05:03:41.511ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d363eaa5-b117-4712-b981-9dd061b0f2d9", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d363eaa5-b117-4712-b981-9dd061b0f2d9" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 152.527051ms
17062025-03-22T05:03:41.693ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27450 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = 8bd81587-1ba3-4f38-b2ac-840117edcbaa response_code = 500 uri = /cockroachdb
17072025-03-22T05:03:41.693ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8bd81587-1ba3-4f38-b2ac-840117edcbaa", "content-length": "124", "date": "Sat, 22 Mar 2025 05:03:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8bd81587-1ba3-4f38-b2ac-840117edcbaa" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 276.630149ms
17082025-03-22T05:03:42.003ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3877
17092025-03-22T05:04:12.516ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3895
17102025-03-22T05:04:22.777ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3918
17112025-03-22T05:04:22.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40807887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33674 req_id = 4e66b9fd-d2cf-4bd4-97b9-d82f8037421e response_code = 204 uri = /cockroachdb
17122025-03-22T05:04:22.783ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39019
17132025-03-22T05:04:22.783ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
17142025-03-22T05:04:22.786ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1139 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39019 req_id = 22896ca6-5be5-4294-a204-231ff702130c response_code = 200 uri = /baseboard
17152025-03-22T05:04:22.786ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
17162025-03-22T05:04:22.787ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
17172025-03-22T05:04:22.788ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
17182025-03-22T05:04:22.860ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(5), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(5), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 47dabbcc-ec67-4cf5-9fdc-e29896133239 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: e268e517-be89-4885-8e3a-f954a2bf9ab5 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eca08ebf-6363-457d-ac26-a0e32f33ca2f (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 (service), filesystem_pool: Some(ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d7ebcd1b-6e68-40c2-a0c6-f49da0e31272, kind: Service { id: 16b1d962-d659-4a4f-ad69-05dd69c8b696 }, name: Name("ntp-16b1d962-d659-4a4f-ad69-05dd69c8b696"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 202b0804-dd28-4e04-88ff-fd30c67affee (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 370a59f1-1551-4b12-84f1-9dea8a286620 (service), filesystem_pool: Some(ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9ebef05b-5a4b-4917-8872-0eb615f55577 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: da3db068-4141-4da6-8520-7d46111d592a (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693 (service), filesystem_pool: Some(ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 066e897f-f97f-4c94-b64d-82bac3890965 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 115623d2-4836-4646-926b-554a07875001 (service), filesystem_pool: Some(ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 12c586aa-24d0-4513-8070-2d9da3388cad (service), filesystem_pool: Some(ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1511f4da-4e33-412f-930d-6cc5c577cd66 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 186e5566-a29f-4f99-978f-972d167fa26d (service), filesystem_pool: Some(ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1cde3350-7ed7-4ada-8958-a39b6b6a45df (service), filesystem_pool: Some(ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e (service), filesystem_pool: Some(ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 522a574f-0efa-4922-b459-92f33337de0c (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 6d25f9e2-5511-49bf-bb65-68a9383eeb25 (service), filesystem_pool: Some(ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6ddbd4af-d400-4bb9-9856-9433d4108ecd (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7b5b0c5d-d623-42b0-880a-690f7271f111 (service), filesystem_pool: Some(ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 87c20588-61bd-46bf-b958-4e80063a43d5 (service), filesystem_pool: Some(ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9db013a7-076b-413d-a7c9-5722c56c76e5 (service), filesystem_pool: Some(ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e (service), filesystem_pool: Some(ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: b6d1e066-9547-4ca6-a406-22fa91e0448f (service), filesystem_pool: Some(ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: f7591d4f-d973-45e6-b68d-3776fb89defa (service), filesystem_pool: Some(ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ff322812-147c-40e7-82e9-fd189e7e937a (service), filesystem_pool: Some(ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External } } }, image_source: InstallDataset }] }
17192025-03-22T05:04:22.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61751
17202025-03-22T05:04:22.864ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17212025-03-22T05:04:22.864ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(5), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 064f33f9-9068-4780-af06-08b1b97b11fb (physical_disk), pool_id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0ce29f3d-0927-47e4-896c-68d6a423cf61 (physical_disk), pool_id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2ca58798-17a0-49da-8300-41700224451b (physical_disk), pool_id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 51235dfa-79bc-4c50-a163-4c24ac04e7ad (physical_disk), pool_id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6130a2dd-cf29-4c01-94c2-a578729dc804 (physical_disk), pool_id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 85acc64f-7ddf-4bf4-8285-915c6acb9852 (physical_disk), pool_id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a8595-1400-46a0-aae4-13e6089aad0c (physical_disk), pool_id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dd5b3c67-573d-4a52-a392-1dde4e1db4ca (physical_disk), pool_id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ebe9eaa3-12da-4cdd-817e-32df2548affd (physical_disk), pool_id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
17222025-03-22T05:04:22.864ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
17232025-03-22T05:04:22.865ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
17242025-03-22T05:04:22.865ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
17252025-03-22T05:04:22.865ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
17262025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
17272025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
17282025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
17292025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
17302025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
17312025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
17322025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
17332025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
17342025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
17352025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
17362025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
17372025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
17382025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
17392025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
17402025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
17412025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
17422025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
17432025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
17442025-03-22T05:04:22.867ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
17452025-03-22T05:04:22.867ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
17462025-03-22T05:04:22.867ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(5), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c2d1b67-1f24-400b-ac37-175a47067aad (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
17472025-03-22T05:04:22.867ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
17482025-03-22T05:04:22.867ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
17492025-03-22T05:04:22.871ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
17502025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17512025-03-22T05:04:22.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17522025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(5) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17532025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17542025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17552025-03-22T05:04:22.872ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(5) sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17562025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17572025-03-22T05:04:22.872ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(5)
17582025-03-22T05:04:22.872ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17592025-03-22T05:04:22.872ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
17602025-03-22T05:04:22.873ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(5), datasets: {0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset): DatasetConfig { id: 0642d79e-56ad-49ee-b1ce-6255d9f90ac3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset): DatasetConfig { id: 0702f3a5-c7db-4edf-9121-c13f8351f7d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10809eaf-ba51-4184-9678-4403fa93701e (dataset): DatasetConfig { id: 10809eaf-ba51-4184-9678-4403fa93701e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset): DatasetConfig { id: 125fa736-c5c3-4eb2-a338-85f8eba5022d (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 142465d6-379a-4298-81f5-4336165efca0 (dataset): DatasetConfig { id: 142465d6-379a-4298-81f5-4336165efca0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset): DatasetConfig { id: 14538a80-1f97-4846-97b2-8a6d08beba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 167e417c-081a-442b-a879-e5092280b6d4 (dataset): DatasetConfig { id: 167e417c-081a-442b-a879-e5092280b6d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset): DatasetConfig { id: 23ba87a8-5806-4f44-bfb6-c8d6a411146c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset): DatasetConfig { id: 23bd79b4-ccb9-4e5d-bc9a-bec0edf30815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset): DatasetConfig { id: 26f5036b-4208-4f92-aa9b-90ea4c69d93b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_16b1d962-d659-4a4f-ad69-05dd69c8b696" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset): DatasetConfig { id: 2d314d6d-a4db-4f6a-8612-ec58cf312e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset): DatasetConfig { id: 2d3d33e2-3fa8-430b-8a7e-2110aca5107e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_370a59f1-1551-4b12-84f1-9dea8a286620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset): DatasetConfig { id: 2d527957-8ebd-41ea-b57b-5f401f8fba33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30fe5652-f169-4a67-b474-41529690378e (dataset): DatasetConfig { id: 30fe5652-f169-4a67-b474-41529690378e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset): DatasetConfig { id: 3318c896-3dca-4b2b-9a42-987f15a3908e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset): DatasetConfig { id: 37de7e7e-cef7-4e74-9cba-5e056a716d0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e268e517-be89-4885-8e3a-f954a2bf9ab5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3955996b-3274-41f9-86dc-959cda74c857 (dataset): DatasetConfig { id: 3955996b-3274-41f9-86dc-959cda74c857 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset): DatasetConfig { id: 3d9153ee-2cad-4401-96d8-e6a40b387004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_da3db068-4141-4da6-8520-7d46111d592a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset): DatasetConfig { id: 3faabebb-cf2c-4205-815d-751bbbddc9d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset): DatasetConfig { id: 4169fe86-c0ad-4607-85c6-a6ff8087ee25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset): DatasetConfig { id: 450b50d6-978c-4ef4-b76c-43ad456ea7cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset): DatasetConfig { id: 4a5ea3df-592e-4be2-9c96-d6ebab2f12d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset): DatasetConfig { id: 5cc5f7a9-1c06-40f3-9d59-0f2883f3802a (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset): DatasetConfig { id: 60a0d639-054d-4701-963c-0c9549d74cd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset): DatasetConfig { id: 62cc3a91-7851-4403-9e80-7b0a64c9d8ed (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_202b0804-dd28-4e04-88ff-fd30c67affee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset): DatasetConfig { id: 65e2f855-4dfd-4c76-b6d3-5be537c883d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset): DatasetConfig { id: 66efacaf-c3d9-4b3f-afef-1e4187752d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset): DatasetConfig { id: 6ae3a38e-30d2-4bea-986e-ddd884e25359 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c971e61-8376-460f-aa36-a312052f45c0 (dataset): DatasetConfig { id: 6c971e61-8376-460f-aa36-a312052f45c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset): DatasetConfig { id: 6dd5d929-f07e-4ef5-b0bd-35881f5e6d3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset): DatasetConfig { id: 6eea1b9c-1b50-42eb-8635-d711f19390f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f5d1bfa8-2047-4f20-bdd3-c4d5fabf0693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset): DatasetConfig { id: 6fc17f40-1657-4b52-909e-6cc040f4a866 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset): DatasetConfig { id: 71e4bdf4-51be-44b3-a8df-f91885721985 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset): DatasetConfig { id: 73256307-7a32-47b9-8b89-4dc579911ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset): DatasetConfig { id: 7cee5ba1-a10c-4a08-9ab2-de2966682d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_115623d2-4836-4646-926b-554a07875001" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset): DatasetConfig { id: 83b226a2-4da9-4bc0-b8d4-db0eccadb7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9ebef05b-5a4b-4917-8872-0eb615f55577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset): DatasetConfig { id: 86b71f0b-1e25-4b4b-b481-a62cb44a4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset): DatasetConfig { id: 8764217a-1f1a-4f0b-8778-d9f88178144c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset): DatasetConfig { id: 8ebe0b41-a191-4ed8-991a-3d1337e8ba1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset): DatasetConfig { id: 8f44fe04-1eef-46aa-84d7-e11b2d459724 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset): DatasetConfig { id: 8f972277-3a89-4d11-94d4-2c2abada9c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92b27851-a28e-4378-8dc7-b71995c73897 (dataset): DatasetConfig { id: 92b27851-a28e-4378-8dc7-b71995c73897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset): DatasetConfig { id: 95c8bb5e-f7d8-44e7-969f-972e909dc968 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset): DatasetConfig { id: 971734f3-8da2-4baa-9d9e-ebfae4d599fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892d785-2fe0-4382-9956-5866c90d731f (dataset): DatasetConfig { id: 9892d785-2fe0-4382-9956-5866c90d731f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab00e730-fe91-40b4-9157-b946a8a7656b (dataset): DatasetConfig { id: ab00e730-fe91-40b4-9157-b946a8a7656b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset): DatasetConfig { id: b2fbdb65-ac34-4234-9d7a-b5d58998ad9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset): DatasetConfig { id: b42cf4fe-83b5-41dd-9897-36624c0aa7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset): DatasetConfig { id: b5c5f978-a53c-42ca-bf7d-8459b43bdc92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d71973-a21c-42ab-a77b-3580219d8926 (dataset): DatasetConfig { id: b6d71973-a21c-42ab-a77b-3580219d8926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_47dabbcc-ec67-4cf5-9fdc-e29896133239" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7e97764-a4c8-4219-b597-b908a87e56ba (dataset): DatasetConfig { id: b7e97764-a4c8-4219-b597-b908a87e56ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba789431-018b-48ae-b020-659308fd8d2f (dataset): DatasetConfig { id: ba789431-018b-48ae-b020-659308fd8d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset): DatasetConfig { id: bd9850a7-9074-4634-bef1-56b39ce5adc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset): DatasetConfig { id: c12ac8af-49c3-47d7-b512-1be3a57cb000 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset): DatasetConfig { id: ce6ad1f8-2006-4bb9-944d-5c0100a4f836 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eca08ebf-6363-457d-ac26-a0e32f33ca2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset): DatasetConfig { id: dc37bd00-6a97-4437-9da2-26e7c1d0382f (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset): DatasetConfig { id: ddc70c6a-181b-4af8-b90a-00aa7d810d01 (dataset), name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e4581a69-da79-4b54-95ff-9195fd964f89 (dataset): DatasetConfig { id: e4581a69-da79-4b54-95ff-9195fd964f89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset): DatasetConfig { id: e7daf35f-ed9e-48b1-9294-e148b77b36f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset): DatasetConfig { id: e8943c08-9716-4c4d-b6f1-7c87ea457813 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset): DatasetConfig { id: f860f30a-ea5b-4982-8388-1e3a0cd8ab4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f884ee8c-5da7-4b36-8095-462538002075 (dataset): DatasetConfig { id: f884ee8c-5da7-4b36-8095-462538002075 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset): DatasetConfig { id: fbdeefea-6f75-4dc7-ba45-f07616e54c87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset): DatasetConfig { id: fd6a8329-3ed9-4d6b-8e35-8d25bb284e4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feec6bf9-c36a-4547-b23a-341131a6d63d (dataset): DatasetConfig { id: feec6bf9-c36a-4547-b23a-341131a6d63d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset): DatasetConfig { id: ff267a21-791c-40d5-bb01-79fb4fcbbbff (dataset), name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
17612025-03-22T05:04:22.873ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
17622025-03-22T05:04:22.873ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
17632025-03-22T05:04:22.874ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
17642025-03-22T05:04:22.874ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(4) request = datasets_ensure requested_generation = Generation(5)
17652025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17662025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17672025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17682025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17692025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17702025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17712025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17722025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17732025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17742025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17752025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17762025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17772025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17782025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17792025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17802025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17812025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
17822025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17832025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17842025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17852025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17862025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17872025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17882025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17892025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17902025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17912025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17922025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17932025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17942025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17952025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17962025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
17972025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17982025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17992025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18002025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18012025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18022025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18032025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18042025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18052025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18062025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18072025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18082025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18092025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18102025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18112025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18122025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18132025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18142025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18152025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18162025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18172025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18182025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18192025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18202025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18212025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18222025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18232025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18242025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18252025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18262025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18272025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18282025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18292025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18302025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18312025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18322025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18332025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18342025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18352025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18362025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18372025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18382025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18392025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18402025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18412025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18422025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18432025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18442025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18452025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18462025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18472025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18482025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18492025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18502025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18512025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18522025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18532025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18542025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18552025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18562025-03-22T05:04:22.940ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18572025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18582025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18592025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18602025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18612025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18622025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18632025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18642025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18652025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18662025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18672025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18682025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18692025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18702025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18712025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18722025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18732025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18742025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18752025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18762025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18772025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18782025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18792025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18802025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18812025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18822025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18832025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18842025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18852025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18862025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18872025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18882025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18892025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18902025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18912025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18922025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18932025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18942025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18952025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18962025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18972025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18982025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18992025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19002025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19012025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19022025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19032025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19042025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19052025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19062025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19072025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19082025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19092025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19102025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19112025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19122025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19132025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19142025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19152025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19162025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19172025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19182025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19192025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19202025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19212025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19222025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
19232025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19242025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19252025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19262025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19272025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19282025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19292025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19302025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19312025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
19322025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19332025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19342025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
19352025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19362025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19372025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19382025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19392025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19402025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19412025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19422025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19432025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19442025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19452025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19462025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19472025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19482025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19492025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19502025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19512025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19522025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19532025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19542025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19552025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19562025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19572025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19582025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
19592025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19602025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19612025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19622025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19632025-03-22T05:04:22.941ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
19642025-03-22T05:04:22.942ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
19652025-03-22T05:04:22.943ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
19662025-03-22T05:04:22.943ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19672025-03-22T05:04:22.943ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
19682025-03-22T05:04:22.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19692025-03-22T05:04:22.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
19702025-03-22T05:04:22.965ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19712025-03-22T05:04:22.965ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
19722025-03-22T05:04:22.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19732025-03-22T05:04:22.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19742025-03-22T05:04:22.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19752025-03-22T05:04:22.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19762025-03-22T05:04:22.996ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19772025-03-22T05:04:22.996ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19782025-03-22T05:04:23.006ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19792025-03-22T05:04:23.006ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19802025-03-22T05:04:23.019ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19812025-03-22T05:04:23.019ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19822025-03-22T05:04:23.030ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19832025-03-22T05:04:23.030ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
19842025-03-22T05:04:23.040ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19852025-03-22T05:04:23.040ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, kind: Crucible }, responder: ... }
19862025-03-22T05:04:23.050ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19872025-03-22T05:04:23.050ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, kind: Crucible }, responder: ... }
19882025-03-22T05:04:23.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19892025-03-22T05:04:23.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Crucible }, responder: ... }
19902025-03-22T05:04:23.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19912025-03-22T05:04:23.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, kind: Crucible }, responder: ... }
19922025-03-22T05:04:23.083ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19932025-03-22T05:04:23.083ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
19942025-03-22T05:04:23.094ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19952025-03-22T05:04:23.094ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, kind: Crucible }, responder: ... }
19962025-03-22T05:04:23.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19972025-03-22T05:04:23.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, kind: Crucible }, responder: ... }
19982025-03-22T05:04:23.114ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19992025-03-22T05:04:23.114ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, kind: Crucible }, responder: ... }
20002025-03-22T05:04:23.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
20012025-03-22T05:04:23.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
20022025-03-22T05:04:23.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
20032025-03-22T05:04:23.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, kind: Crucible }, responder: ... }
20042025-03-22T05:04:23.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
20052025-03-22T05:04:23.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, kind: Crucible }, responder: ... }
20062025-03-22T05:04:23.153ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20072025-03-22T05:04:23.153ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
20082025-03-22T05:04:23.153ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
20092025-03-22T05:04:23.154ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
20102025-03-22T05:04:23.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20112025-03-22T05:04:23.280ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20122025-03-22T05:04:23.295ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20132025-03-22T05:04:23.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20142025-03-22T05:04:23.321ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20152025-03-22T05:04:23.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20162025-03-22T05:04:23.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20172025-03-22T05:04:23.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20182025-03-22T05:04:23.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20192025-03-22T05:04:23.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20202025-03-22T05:04:23.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20212025-03-22T05:04:23.545ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20222025-03-22T05:04:23.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20232025-03-22T05:04:23.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20242025-03-22T05:04:23.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20252025-03-22T05:04:23.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20262025-03-22T05:04:23.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20272025-03-22T05:04:23.546ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20282025-03-22T05:04:23.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20292025-03-22T05:04:23.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20302025-03-22T05:04:23.571ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad file = illumos-utils/src/zone.rs:356
20312025-03-22T05:04:23.576ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d file = illumos-utils/src/zone.rs:356
20322025-03-22T05:04:23.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111 file = illumos-utils/src/zone.rs:356
20332025-03-22T05:04:23.588ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f file = illumos-utils/src/zone.rs:356
20342025-03-22T05:04:23.594ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a file = illumos-utils/src/zone.rs:356
20352025-03-22T05:04:23.600ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df file = illumos-utils/src/zone.rs:356
20362025-03-22T05:04:23.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25 file = illumos-utils/src/zone.rs:356
20372025-03-22T05:04:23.754ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad file = illumos-utils/src/zone.rs:394
20382025-03-22T05:04:23.759ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d file = illumos-utils/src/zone.rs:394
20392025-03-22T05:04:23.765ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111 file = illumos-utils/src/zone.rs:394
20402025-03-22T05:04:23.770ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f file = illumos-utils/src/zone.rs:394
20412025-03-22T05:04:23.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a file = illumos-utils/src/zone.rs:394
20422025-03-22T05:04:23.781ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df file = illumos-utils/src/zone.rs:394
20432025-03-22T05:04:23.786ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25 file = illumos-utils/src/zone.rs:394
20442025-03-22T05:04:23.792ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e file = illumos-utils/src/zone.rs:356
20452025-03-22T05:04:23.798ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5 file = illumos-utils/src/zone.rs:356
20462025-03-22T05:04:23.803ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5 file = illumos-utils/src/zone.rs:356
20472025-03-22T05:04:23.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa file = illumos-utils/src/zone.rs:356
20482025-03-22T05:04:23.815ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd file = illumos-utils/src/zone.rs:356
20492025-03-22T05:04:23.823ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_115623d2-4836-4646-926b-554a07875001 file = illumos-utils/src/zone.rs:356
20502025-03-22T05:04:23.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66 file = illumos-utils/src/zone.rs:356
20512025-03-22T05:04:23.898ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20522025-03-22T05:04:23.952ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20532025-03-22T05:04:24.001ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20542025-03-22T05:04:24.001ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e file = illumos-utils/src/zone.rs:394
20552025-03-22T05:04:24.011ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5 file = illumos-utils/src/zone.rs:394
20562025-03-22T05:04:24.019ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5 file = illumos-utils/src/zone.rs:394
20572025-03-22T05:04:24.027ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa file = illumos-utils/src/zone.rs:394
20582025-03-22T05:04:24.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd file = illumos-utils/src/zone.rs:394
20592025-03-22T05:04:24.044ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_115623d2-4836-4646-926b-554a07875001 file = illumos-utils/src/zone.rs:394
20602025-03-22T05:04:24.051ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66 file = illumos-utils/src/zone.rs:394
20612025-03-22T05:04:24.115ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20622025-03-22T05:04:24.172ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20632025-03-22T05:04:24.176ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20642025-03-22T05:04:24.176ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20652025-03-22T05:04:24.245ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 245, 137]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
20662025-03-22T05:04:24.245ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
20672025-03-22T05:04:24.249ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20682025-03-22T05:04:24.249ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20692025-03-22T05:04:24.304ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 165, 187]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20702025-03-22T05:04:24.304ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20712025-03-22T05:04:24.306ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20722025-03-22T05:04:24.306ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20732025-03-22T05:04:24.412ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 193, 174]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
20742025-03-22T05:04:24.412ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
20752025-03-22T05:04:24.423ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20762025-03-22T05:04:24.423ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20772025-03-22T05:04:24.510ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 197, 73]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20782025-03-22T05:04:24.510ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20792025-03-22T05:04:24.512ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20802025-03-22T05:04:24.512ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20812025-03-22T05:04:24.603ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 244, 120]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20822025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20832025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
20842025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
20852025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
20862025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
20872025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
20882025-03-22T05:04:24.603ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
20892025-03-22T05:04:24.611ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
20902025-03-22T05:04:24.611ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
20912025-03-22T05:04:24.611ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
20922025-03-22T05:04:24.611ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
20932025-03-22T05:04:24.638ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
20942025-03-22T05:04:24.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20952025-03-22T05:04:24.723ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
20962025-03-22T05:04:24.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20972025-03-22T05:04:24.735ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
20982025-03-22T05:04:24.741ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
20992025-03-22T05:04:24.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21002025-03-22T05:04:24.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21012025-03-22T05:04:24.746ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
21022025-03-22T05:04:24.754ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad file = illumos-utils/src/zone.rs:356
21032025-03-22T05:04:24.988ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21042025-03-22T05:04:24.988ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad file = illumos-utils/src/zone.rs:394
21052025-03-22T05:04:25.003ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965 file = illumos-utils/src/zone.rs:356
21062025-03-22T05:04:25.013ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 file = illumos-utils/src/zone.rs:356
21072025-03-22T05:04:25.074ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965 file = illumos-utils/src/zone.rs:394
21082025-03-22T05:04:25.085ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 file = illumos-utils/src/zone.rs:394
21092025-03-22T05:04:25.096ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e file = illumos-utils/src/zone.rs:356
21102025-03-22T05:04:25.109ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c file = illumos-utils/src/zone.rs:356
21112025-03-22T05:04:25.148ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e file = illumos-utils/src/zone.rs:394
21122025-03-22T05:04:25.158ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c file = illumos-utils/src/zone.rs:394
21132025-03-22T05:04:32.224ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21142025-03-22T05:04:32.230ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21152025-03-22T05:04:32.230ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21162025-03-22T05:04:32.258ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21172025-03-22T05:04:32.390ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='65b7607d-1dfd-425c-8b60-f7e9e20253f9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21182025-03-22T05:04:32.395ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b47c4962-4319-408d-9df5-7ff4139e32f5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dcdd49f4-81fd-4463-9d14-a3e96a7f906d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21192025-03-22T05:04:32.396ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21202025-03-22T05:04:32.406ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c1790182-2ff1-4e89-b1e7-56f5d798fddc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21212025-03-22T05:04:32.406ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21222025-03-22T05:04:32.413ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f282df4c-a498-441e-a714-cfa606ade1c7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='38462d04-a53d-4411-b83d-9ea9ae9a96bb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21232025-03-22T05:04:32.416ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='916c0af7-50be-4550-a8d8-a9aa3015adb8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21242025-03-22T05:04:32.420ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a428060b-1f75-4c80-8a13-ad9f3c15006c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21252025-03-22T05:04:32.420ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5436dcfe-a58e-4d96-a581-643f03565c69/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7a4bfd20-d0ca-46c0-a5df-c0655d505f94'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21262025-03-22T05:04:32.420ZINFOSledAgent (ServiceManager): Booting oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21272025-03-22T05:04:32.428ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21282025-03-22T05:04:32.436ZINFOSledAgent (ServiceManager): Booting oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21292025-03-22T05:04:32.443ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21302025-03-22T05:04:32.450ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21312025-03-22T05:04:32.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 64.223446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21322025-03-22T05:04:32.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 41.984112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21332025-03-22T05:04:32.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 38.424407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21342025-03-22T05:04:32.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 43.233199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21352025-03-22T05:04:32.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 27.186232ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21362025-03-22T05:04:32.984ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 49.033503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21372025-03-22T05:04:33.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 48.824849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21382025-03-22T05:04:33.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 30.912581ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21392025-03-22T05:04:33.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 73.437388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21402025-03-22T05:04:33.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 118.837656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21412025-03-22T05:04:33.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 53.60108ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21422025-03-22T05:04:33.071ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 138.79257ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21432025-03-22T05:04:33.085ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 52.338373ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21442025-03-22T05:04:33.099ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 55.962088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21452025-03-22T05:04:33.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 81.825604ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21462025-03-22T05:04:33.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 130.431074ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21472025-03-22T05:04:33.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 54.713258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21482025-03-22T05:04:33.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 87.330984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21492025-03-22T05:04:33.162ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21502025-03-22T05:04:33.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 290.11913ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21512025-03-22T05:04:33.195ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 207.693992ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21522025-03-22T05:04:33.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 112.384963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21532025-03-22T05:04:33.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 145.060611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21542025-03-22T05:04:33.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 145.825505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21552025-03-22T05:04:33.241ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
21562025-03-22T05:04:33.266ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 246.980275ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21572025-03-22T05:04:33.282ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 220.660904ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21582025-03-22T05:04:33.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 195.041816ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21592025-03-22T05:04:33.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 214.273531ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21602025-03-22T05:04:33.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 505.588725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21612025-03-22T05:04:33.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 431.354552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21622025-03-22T05:04:33.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 403.401338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21632025-03-22T05:04:33.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 332.145916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21642025-03-22T05:04:33.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 337.641289ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21652025-03-22T05:04:33.487ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b6d1e066-9547-4ca6-a406-22fa91e0448f'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21662025-03-22T05:04:33.489ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
21672025-03-22T05:04:33.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 256.239487ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21682025-03-22T05:04:33.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 320.491406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21692025-03-22T05:04:33.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 26.651828ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
21702025-03-22T05:04:33.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 475.848432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21712025-03-22T05:04:33.562ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 320.542399ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21722025-03-22T05:04:33.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 113.829949ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
21732025-03-22T05:04:33.768ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 125.345152ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
21742025-03-22T05:04:33.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 642.887269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21752025-03-22T05:04:33.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 912.630872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
21762025-03-22T05:04:33.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 839.496869ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
21772025-03-22T05:04:33.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 544.903614ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21782025-03-22T05:04:33.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 726.487835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
21792025-03-22T05:04:33.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 569.400735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
21802025-03-22T05:04:34.014ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 575.09637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
21812025-03-22T05:04:34.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 566.937596ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
21822025-03-22T05:04:34.067ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.156374511s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
21832025-03-22T05:04:34.086ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 48.484002ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
21842025-03-22T05:04:34.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 475.333339ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
21852025-03-22T05:04:34.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 87.411724ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
21862025-03-22T05:04:34.232ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_25a954fe-dd77-4935-9929-93fce92615d1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f685df15-633b-4dfe-a736-99c7fe12cdc1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21872025-03-22T05:04:34.233ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
21882025-03-22T05:04:34.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 149.497961ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
21892025-03-22T05:04:34.290ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21902025-03-22T05:04:34.291ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
21912025-03-22T05:04:34.303ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_115623d2-4836-4646-926b-554a07875001: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7deb16a6-d604-4284-9783-3c07eddc30d2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e1c0fa01-9ce9-4474-a437-5fee4e4269dd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21922025-03-22T05:04:34.304ZINFOSledAgent (ServiceManager): Booting oxz_crucible_115623d2-4836-4646-926b-554a07875001 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
21932025-03-22T05:04:34.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 571.994913ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
21942025-03-22T05:04:34.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 763.125005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
21952025-03-22T05:04:34.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.383694503s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
21962025-03-22T05:04:34.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 66.473687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
21972025-03-22T05:04:34.509ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21982025-03-22T05:04:34.509ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
21992025-03-22T05:04:34.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 54.604005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22002025-03-22T05:04:34.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.472774192s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
22012025-03-22T05:04:34.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 787.069144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
22022025-03-22T05:04:34.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 62.563183ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22032025-03-22T05:04:34.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 125.036049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22042025-03-22T05:04:34.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.038185306s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
22052025-03-22T05:04:34.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.302628334s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
22062025-03-22T05:04:34.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 126.673406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22072025-03-22T05:04:34.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 145.94927ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22082025-03-22T05:04:34.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 932.988021ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
22092025-03-22T05:04:34.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.214815896s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
22102025-03-22T05:04:34.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.431647836s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
22112025-03-22T05:04:34.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 258.235507ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22122025-03-22T05:04:34.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 30.358994ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22132025-03-22T05:04:34.809ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 266.276925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22142025-03-22T05:04:34.829ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 133.553383ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22152025-03-22T05:04:34.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 244.105493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22162025-03-22T05:04:34.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 285.965022ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22172025-03-22T05:04:35.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 833.825091ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
22182025-03-22T05:04:35.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 278.839269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22192025-03-22T05:04:35.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 316.030912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22202025-03-22T05:04:35.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 543.272916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22212025-03-22T05:04:35.202ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22222025-03-22T05:04:35.202ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22232025-03-22T05:04:35.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 769.527176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
22242025-03-22T05:04:35.221ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22252025-03-22T05:04:35.228ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22262025-03-22T05:04:35.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 707.435329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
22272025-03-22T05:04:35.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 460.637295ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22282025-03-22T05:04:35.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.062117658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22292025-03-22T05:04:35.407ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 934.452124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
22302025-03-22T05:04:35.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.150380568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22312025-03-22T05:04:35.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 33.323708ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22322025-03-22T05:04:35.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 32.824891ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22332025-03-22T05:04:35.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 74.591634ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22342025-03-22T05:04:35.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 144.8112ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22352025-03-22T05:04:35.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 287.042393ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22362025-03-22T05:04:35.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 799.473571ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
22372025-03-22T05:04:35.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 447.820773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22382025-03-22T05:04:35.677ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22392025-03-22T05:04:35.677ZINFOSledAgent (ServiceManager): Booting oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22402025-03-22T05:04:35.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 141.627578ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22412025-03-22T05:04:35.705ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 628.802694ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
22422025-03-22T05:04:35.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.068953921s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22432025-03-22T05:04:35.846ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 375.55078ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22442025-03-22T05:04:35.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 612.299411ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
22452025-03-22T05:04:35.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.221519729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
22462025-03-22T05:04:35.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 64.30436ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22472025-03-22T05:04:35.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 432.979331ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22482025-03-22T05:04:35.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 572.046696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
22492025-03-22T05:04:35.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 898.602764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
22502025-03-22T05:04:36.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.094127813s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
22512025-03-22T05:04:36.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.16682979s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
22522025-03-22T05:04:36.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.363335424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
22532025-03-22T05:04:36.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.305502961s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
22542025-03-22T05:04:36.362ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 61.087114ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22552025-03-22T05:04:36.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.214711543s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22562025-03-22T05:04:36.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 796.916714ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
22572025-03-22T05:04:36.397ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 809.25086ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22582025-03-22T05:04:36.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.163282002s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
22592025-03-22T05:04:36.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.06379877s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22602025-03-22T05:04:36.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 144.067198ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22612025-03-22T05:04:36.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.41860819s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22622025-03-22T05:04:36.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 1.338814499s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
22632025-03-22T05:04:36.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.152438456s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
22642025-03-22T05:04:36.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 871.16838ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
22652025-03-22T05:04:36.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 635.552158ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22662025-03-22T05:04:36.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 400.932374ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22672025-03-22T05:04:36.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 982.076893ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22682025-03-22T05:04:36.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 984.515051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
22692025-03-22T05:04:37.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.046375553s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22702025-03-22T05:04:37.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 744.549038ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
22712025-03-22T05:04:37.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.22797335s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
22722025-03-22T05:04:37.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.249509004s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
22732025-03-22T05:04:37.219ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.074894977s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22742025-03-22T05:04:37.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 673.148588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22752025-03-22T05:04:37.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.110823508s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
22762025-03-22T05:04:37.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.430474803s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
22772025-03-22T05:04:37.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 913.049856ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22782025-03-22T05:04:37.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.409535674s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
22792025-03-22T05:04:37.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 667.228721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22802025-03-22T05:04:37.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 965.619912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
22812025-03-22T05:04:37.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 518.419791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
22822025-03-22T05:04:37.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 958.404034ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
22832025-03-22T05:04:37.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 801.728284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
22842025-03-22T05:04:37.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 676.139731ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22852025-03-22T05:04:37.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 621.285859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
22862025-03-22T05:04:37.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.072813191s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
22872025-03-22T05:04:38.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.036341072s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
22882025-03-22T05:04:38.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.121621147s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
22892025-03-22T05:04:38.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 731.596575ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
22902025-03-22T05:04:38.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.286330456s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
22912025-03-22T05:04:38.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.131694469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
22922025-03-22T05:04:38.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.326295156s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
22932025-03-22T05:04:38.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.225524453s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
22942025-03-22T05:04:38.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 551.070825ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
22952025-03-22T05:04:38.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 862.0421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
22962025-03-22T05:04:38.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.479681497s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
22972025-03-22T05:04:38.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 583.314899ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
22982025-03-22T05:04:38.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.162646496s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
22992025-03-22T05:04:38.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.230799484s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
23002025-03-22T05:04:38.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.393408626s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
23012025-03-22T05:04:38.898ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 85.545178572s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
23022025-03-22T05:04:38.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.370897445s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23032025-03-22T05:04:38.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.173691524s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
23042025-03-22T05:04:38.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.409340446s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23052025-03-22T05:04:39.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.449360478s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
23062025-03-22T05:04:39.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 570.870806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23072025-03-22T05:04:39.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 942.938965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
23082025-03-22T05:04:39.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 767.744923ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23092025-03-22T05:04:39.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.46916015s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
23102025-03-22T05:04:39.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 778.140226ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23112025-03-22T05:04:39.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.040532176s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23122025-03-22T05:04:39.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 753.791461ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23132025-03-22T05:04:39.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 861.507654ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
23142025-03-22T05:04:39.609ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 517.185773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23152025-03-22T05:04:39.770ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.404203263s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
23162025-03-22T05:04:39.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 891.308013ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23172025-03-22T05:04:39.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.065851408s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23182025-03-22T05:04:39.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 587.119207ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
23192025-03-22T05:04:40.038ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.282903594s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
23202025-03-22T05:04:40.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.359980174s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
23212025-03-22T05:04:40.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.037239762s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
23222025-03-22T05:04:40.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.019998548s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
23232025-03-22T05:04:40.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 809.899849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23242025-03-22T05:04:40.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.004121812s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23252025-03-22T05:04:40.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.233710037s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
23262025-03-22T05:04:40.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 598.626322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23272025-03-22T05:04:40.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.464323203s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23282025-03-22T05:04:40.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.23794698s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23292025-03-22T05:04:40.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.115959848s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
23302025-03-22T05:04:40.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 866.815691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
23312025-03-22T05:04:40.513ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 815.940691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23322025-03-22T05:04:40.528ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.016215211s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
23332025-03-22T05:04:40.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 979.261916ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23342025-03-22T05:04:40.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.379736511s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
23352025-03-22T05:04:40.896ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 564.620384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23362025-03-22T05:04:40.950ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 667.652275ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23372025-03-22T05:04:40.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.146189843s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23382025-03-22T05:04:41.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.349797639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23392025-03-22T05:04:41.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.381885538s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
23402025-03-22T05:04:41.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 854.369842ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
23412025-03-22T05:04:41.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.430152109s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
23422025-03-22T05:04:41.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.124753359s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
23432025-03-22T05:04:41.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 542.638033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23442025-03-22T05:04:41.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.136166068s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
23452025-03-22T05:04:41.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.073185916s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
23462025-03-22T05:04:41.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.445683324s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23472025-03-22T05:04:41.494ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 907.251474ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
23482025-03-22T05:04:41.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 676.558315ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
23492025-03-22T05:04:41.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.343424928s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
23502025-03-22T05:04:41.592ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 547.668857ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23512025-03-22T05:04:41.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 1.469524404s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23522025-03-22T05:04:41.670ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 537.014587ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23532025-03-22T05:04:41.768ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.409264853s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23542025-03-22T05:04:41.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.357180949s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23552025-03-22T05:04:42.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.389124144s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
23562025-03-22T05:04:42.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 995.582725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
23572025-03-22T05:04:42.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.262572716s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23582025-03-22T05:04:42.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 842.619216ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23592025-03-22T05:04:42.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 584.377821ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23602025-03-22T05:04:42.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.007795028s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
23612025-03-22T05:04:42.411ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.353293437s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
23622025-03-22T05:04:42.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.101073353s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
23632025-03-22T05:04:42.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.077550668s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
23642025-03-22T05:04:42.507ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.116951325s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
23652025-03-22T05:04:42.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.310901724s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23662025-03-22T05:04:42.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 725.098465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
23672025-03-22T05:04:42.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 881.233009ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
23682025-03-22T05:04:42.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 666.320025ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23692025-03-22T05:04:42.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.423000281s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23702025-03-22T05:04:42.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.119527637s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
23712025-03-22T05:04:43.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.448489428s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23722025-03-22T05:04:43.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.073999362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
23732025-03-22T05:04:43.106ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 570.441033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23742025-03-22T05:04:43.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 705.101503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23752025-03-22T05:04:43.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.442888418s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
23762025-03-22T05:04:43.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.132863721s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23772025-03-22T05:04:43.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.300867634s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
23782025-03-22T05:04:43.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 871.407838ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23792025-03-22T05:04:43.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.116581456s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
23802025-03-22T05:04:43.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 736.629595ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23812025-03-22T05:04:43.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.178078188s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
23822025-03-22T05:04:43.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.324961152s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
23832025-03-22T05:04:43.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.387490819s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
23842025-03-22T05:04:43.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.060365848s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
23852025-03-22T05:04:43.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 1.469163499s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
23862025-03-22T05:04:43.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.366881262s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
23872025-03-22T05:04:43.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 552.361077ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23882025-03-22T05:04:43.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 565.132685ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23892025-03-22T05:04:44.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.369901244s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
23902025-03-22T05:04:44.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.472382162s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
23912025-03-22T05:04:44.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.228232458s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
23922025-03-22T05:04:44.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 862.502221ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
23932025-03-22T05:04:44.362ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 828.343145ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
23942025-03-22T05:04:44.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 855.127147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
23952025-03-22T05:04:44.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.253597309s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
23962025-03-22T05:04:44.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.190503911s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
23972025-03-22T05:04:44.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.361026674s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
23982025-03-22T05:04:44.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.439612682s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
23992025-03-22T05:04:44.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.332481306s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
24002025-03-22T05:04:44.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.168202323s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
24012025-03-22T05:04:44.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.172883527s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
24022025-03-22T05:04:44.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 640.947325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24032025-03-22T05:04:44.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 725.089271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
24042025-03-22T05:04:44.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.107876418s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
24052025-03-22T05:04:45.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.249151441s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
24062025-03-22T05:04:45.171ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 691.510878ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24072025-03-22T05:04:45.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.281033817s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
24082025-03-22T05:04:45.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.081649511s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
24092025-03-22T05:04:45.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.446263801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
24102025-03-22T05:04:45.300ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
24112025-03-22T05:04:45.301ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24122025-03-22T05:04:45.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.332650849s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24132025-03-22T05:04:45.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.438220124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
24142025-03-22T05:04:45.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 556.030237ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
24152025-03-22T05:04:45.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 31.296169ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24162025-03-22T05:04:45.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 56.832996ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24172025-03-22T05:04:45.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.426642659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
24182025-03-22T05:04:45.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.087045826s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
24192025-03-22T05:04:45.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 826.82943ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
24202025-03-22T05:04:45.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 137.258075ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24212025-03-22T05:04:45.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 660.368122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
24222025-03-22T05:04:45.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.396492942s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
24232025-03-22T05:04:45.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 697.589741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24242025-03-22T05:04:45.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.293952021s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
24252025-03-22T05:04:45.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 315.505486ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24262025-03-22T05:04:45.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.405108072s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
24272025-03-22T05:04:45.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.00576322s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
24282025-03-22T05:04:46.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.286707982s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
24292025-03-22T05:04:46.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.117885975s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
24302025-03-22T05:04:46.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.0577138s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
24312025-03-22T05:04:46.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 511.281745ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24322025-03-22T05:04:46.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 863.912403ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
24332025-03-22T05:04:46.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.457211894s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
24342025-03-22T05:04:46.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 634.1396ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
24352025-03-22T05:04:46.478ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 711.555081ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
24362025-03-22T05:04:46.540ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 542.584599ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
24372025-03-22T05:04:46.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 1.314597999s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24382025-03-22T05:04:46.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 662.88892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24392025-03-22T05:04:46.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 807.179072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
24402025-03-22T05:04:46.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.232853078s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24412025-03-22T05:04:46.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.109456348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
24422025-03-22T05:04:46.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.499457907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
24432025-03-22T05:04:46.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 780.030607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
24442025-03-22T05:04:47.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.237328924s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
24452025-03-22T05:04:47.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 957.795297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
24462025-03-22T05:04:47.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.387465217s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
24472025-03-22T05:04:47.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.002352261s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
24482025-03-22T05:04:47.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 792.115679ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
24492025-03-22T05:04:47.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 712.217189ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
24502025-03-22T05:04:47.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.325624065s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
24512025-03-22T05:04:47.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.001225715s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
24522025-03-22T05:04:47.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.469756179s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
24532025-03-22T05:04:47.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.494056315s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
24542025-03-22T05:04:47.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.296449865s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
24552025-03-22T05:04:47.415ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 701.873996ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24562025-03-22T05:04:47.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 933.795189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
24572025-03-22T05:04:47.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.21113809s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
24582025-03-22T05:04:47.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 942.753527ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
24592025-03-22T05:04:47.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 812.171926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
24602025-03-22T05:04:47.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 973.877586ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
24612025-03-22T05:04:47.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 570.189174ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24622025-03-22T05:04:47.993ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.358884995s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
24632025-03-22T05:04:48.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.133465135s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24642025-03-22T05:04:48.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 673.1963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
24652025-03-22T05:04:48.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 783.911039ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24662025-03-22T05:04:48.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 999.635261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
24672025-03-22T05:04:48.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.351174436s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
24682025-03-22T05:04:48.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.342743294s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
24692025-03-22T05:04:48.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 893.399983ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
24702025-03-22T05:04:48.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 985.338728ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24712025-03-22T05:04:48.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 798.962254ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
24722025-03-22T05:04:48.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.318761746s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
24732025-03-22T05:04:48.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.498880852s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
24742025-03-22T05:04:48.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 643.5111ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
24752025-03-22T05:04:48.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 626.594755ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
24762025-03-22T05:04:48.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 561.9976ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
24772025-03-22T05:04:48.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.245813385s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
24782025-03-22T05:04:48.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.483303622s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
24792025-03-22T05:04:48.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 982.528111ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
24802025-03-22T05:04:48.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.370034038s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
24812025-03-22T05:04:48.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 548.875725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24822025-03-22T05:04:49.014ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.224826664s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
24832025-03-22T05:04:49.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 520.36439ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24842025-03-22T05:04:49.204ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 943.2804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
24852025-03-22T05:04:49.319ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 1.007248334s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
24862025-03-22T05:04:49.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.193056141s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
24872025-03-22T05:04:49.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 520.420461ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
24882025-03-22T05:04:49.360ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 571.985891ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
24892025-03-22T05:04:49.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.099496394s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
24902025-03-22T05:04:49.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 722.198866ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
24912025-03-22T05:04:49.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.073183127s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
24922025-03-22T05:04:49.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 802.630801ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
24932025-03-22T05:04:49.603ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 949.05419ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
24942025-03-22T05:04:49.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.483519779s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
24952025-03-22T05:04:49.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 588.431841ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
24962025-03-22T05:04:49.854ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.091498479s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
24972025-03-22T05:04:49.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.144560793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
24982025-03-22T05:04:49.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 577.461968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
24992025-03-22T05:04:49.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.066517803s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
25002025-03-22T05:04:50.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 942.415569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
25012025-03-22T05:04:50.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.064437634s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
25022025-03-22T05:04:50.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 1.111168074s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
25032025-03-22T05:04:50.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 649.844605ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
25042025-03-22T05:04:50.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 660.629138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
25052025-03-22T05:04:50.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 501.188043ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
25062025-03-22T05:04:50.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 757.639442ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
25072025-03-22T05:04:50.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.194476512s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
25082025-03-22T05:04:50.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 898.972657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
25092025-03-22T05:04:50.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 855.231661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
25102025-03-22T05:04:50.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 797.986269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
25112025-03-22T05:04:50.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 811.289424ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
25122025-03-22T05:04:50.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 1.229355237s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
25132025-03-22T05:04:50.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 1.103326823s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
25142025-03-22T05:04:50.580ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 620.599646ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
25152025-03-22T05:04:50.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 843.887096ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
25162025-03-22T05:04:50.824ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 1.266991999s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
25172025-03-22T05:04:50.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.414356383s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
25182025-03-22T05:04:50.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.152399988s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
25192025-03-22T05:04:50.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e") failed: Property not found. retry in 1.468287332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
25202025-03-22T05:04:51.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 813.264145ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
25212025-03-22T05:04:51.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a") failed: Property not found. retry in 1.338676011s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
25222025-03-22T05:04:51.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.180335177s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
25232025-03-22T05:04:51.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.03368119s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
25242025-03-22T05:04:51.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 801.239335ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25252025-03-22T05:04:51.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d") failed: Property not found. retry in 1.333537129s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
25262025-03-22T05:04:51.230ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 1.146069056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
25272025-03-22T05:04:51.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 646.973689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
25282025-03-22T05:04:51.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25") failed: Property not found. retry in 764.469488ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
25292025-03-22T05:04:51.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.063013394s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
25302025-03-22T05:04:51.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 1.287683201s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
25312025-03-22T05:04:51.544ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90") failed: Property not found. retry in 1.036246951s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
25322025-03-22T05:04:51.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 633.777839ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
25332025-03-22T05:04:51.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 528.344035ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
25342025-03-22T05:04:51.783ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 536.564154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
25352025-03-22T05:04:51.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad") failed: Property not found. retry in 1.063815063s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
25362025-03-22T05:04:51.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66") failed: Property not found. retry in 731.25029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
25372025-03-22T05:04:52.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.405868634s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25382025-03-22T05:04:52.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df") failed: Property not found. retry in 974.364525ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
25392025-03-22T05:04:52.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f") failed: Property not found. retry in 1.376976602s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
25402025-03-22T05:04:52.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad") failed: Property not found. retry in 1.098358597s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
25412025-03-22T05:04:52.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e") failed: Property not found. retry in 665.743607ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
25422025-03-22T05:04:52.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965") failed: Property not found. retry in 1.492744339s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
25432025-03-22T05:04:52.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c") failed: Property not found. retry in 1.146234466s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
25442025-03-22T05:04:52.329ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_115623d2-4836-4646-926b-554a07875001") failed: Property not found. retry in 760.08507ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
25452025-03-22T05:04:52.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111") failed: Property not found. retry in 1.249483155s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
25462025-03-22T05:04:52.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd") failed: Property not found. retry in 1.343291729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
25472025-03-22T05:04:52.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa") failed: Property not found. retry in 832.590416ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
25482025-03-22T05:04:52.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5") failed: Property not found. retry in 721.223653ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
25492025-03-22T05:04:52.942ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41505
25502025-03-22T05:04:52.955ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6609 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41505 req_id = 93198c78-7b1c-45c5-8a6b-011c0b256b14 response_code = 200 uri = /baseboard
25512025-03-22T05:04:53.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 629.243289ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25522025-03-22T05:04:54.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 578.545993ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25532025-03-22T05:04:54.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 595.573909ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25542025-03-22T05:04:55.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.423781135s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25552025-03-22T05:04:56.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 516.59457ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25562025-03-22T05:04:57.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 557.854105ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25572025-03-22T05:04:57.823ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 664.198767ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25582025-03-22T05:04:58.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 1.164247138s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25592025-03-22T05:04:59.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 725.967413ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25602025-03-22T05:05:00.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 512.566653ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25612025-03-22T05:05:00.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 833.063669ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25622025-03-22T05:05:01.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 860.528202ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25632025-03-22T05:05:02.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 829.488553ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25642025-03-22T05:05:03.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 831.350255ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25652025-03-22T05:05:04.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5") failed: Property not found. retry in 799.497401ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25662025-03-22T05:05:04.442ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/probe_manager.rs:234 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
25672025-03-22T05:05:04.444ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f634dba2-8c5d-4b36-ba71-7efa6e33985c) file = sled-agent/src/nexus.rs:530 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
25682025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_external_dns_522a574f-0efa-4922-b459-92f33337de0c
25692025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_12c586aa-24d0-4513-8070-2d9da3388cad
25702025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_4853a98e-3dee-4dfc-ae1a-a638b142b7ad
25712025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_186e5566-a29f-4f99-978f-972d167fa26d
25722025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_7b5b0c5d-d623-42b0-880a-690f7271f111
25732025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_oximeter_b6d1e066-9547-4ca6-a406-22fa91e0448f
25742025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_external_dns_066e897f-f97f-4c94-b64d-82bac3890965
25752025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_ff322812-147c-40e7-82e9-fd189e7e937a
25762025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_1cde3350-7ed7-4ada-8958-a39b6b6a45df
25772025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_6d25f9e2-5511-49bf-bb65-68a9383eeb25
25782025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_a94e29fb-e6b3-4bc0-b6e1-7244d31e0d6e
25792025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_clickhouse_9db013a7-076b-413d-a7c9-5722c56c76e5
25802025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_87c20588-61bd-46bf-b958-4e80063a43d5
25812025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_f7591d4f-d973-45e6-b68d-3776fb89defa
25822025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_6ddbd4af-d400-4bb9-9856-9433d4108ecd
25832025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90
25842025-03-22T05:05:05.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_34c000f6-dc91-4da0-8401-c69f9ab4b07e
25852025-03-22T05:05:05.169ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_115623d2-4836-4646-926b-554a07875001
25862025-03-22T05:05:05.169ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_1511f4da-4e33-412f-930d-6cc5c577cd66
25872025-03-22T05:05:05.171ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
25882025-03-22T05:05:05.174ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
25892025-03-22T05:05:05.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42316574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61751 req_id = cbae4c25-312a-4f6a-957f-67513155d71d response_code = 200 uri = /omicron-config
25902025-03-22T05:05:05.196ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1358
25912025-03-22T05:05:05.200ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:738
25922025-03-22T05:05:05.202ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:751
25932025-03-22T05:05:05.258ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:951
25942025-03-22T05:05:05.382ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "04c47f2f-4785-44fb-bffe-d5bd09ec7c25", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "04c47f2f-4785-44fb-bffe-d5bd09ec7c25" } file = sled-agent/src/rack_setup/service.rs:1011
25952025-03-22T05:05:05.572ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "976952ca-b63f-4c8d-b6d6-b22bf55a059f", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "976952ca-b63f-4c8d-b6d6-b22bf55a059f" } file = sled-agent/src/rack_setup/service.rs:1011
25962025-03-22T05:05:05.735ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3ea2fd8d-31a5-460d-87fb-0dad25004911", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "3ea2fd8d-31a5-460d-87fb-0dad25004911" } file = sled-agent/src/rack_setup/service.rs:1011
25972025-03-22T05:05:05.946ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c778339f-1488-4de5-9593-7a61c82fd07c", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "c778339f-1488-4de5-9593-7a61c82fd07c" } file = sled-agent/src/rack_setup/service.rs:1011
25982025-03-22T05:05:06.260ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9e98ba90-9ea7-4306-9d99-0a38320b82d1", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "9e98ba90-9ea7-4306-9d99-0a38320b82d1" } file = sled-agent/src/rack_setup/service.rs:1011
25992025-03-22T05:05:06.543ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c9a5bf29-153f-4f9f-9417-4243551e35de", "content-length": "173", "date": "Sat, 22 Mar 2025 05:05:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"5a80395d-2a13-488f-b69d-b25376304a78\"", request_id: "c9a5bf29-153f-4f9f-9417-4243551e35de" } file = sled-agent/src/rack_setup/service.rs:1011
26002025-03-22T05:05:07.698ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
26012025-03-22T05:05:08.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43935
26022025-03-22T05:05:08.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26032025-03-22T05:05:08.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26042025-03-22T05:05:08.121ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
26052025-03-22T05:05:08.123ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
26062025-03-22T05:05:08.144ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26072025-03-22T05:05:08.144ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
26082025-03-22T05:05:08.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-03-22T05:05:08.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
26102025-03-22T05:05:08.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-03-22T05:05:08.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
26122025-03-22T05:05:08.219ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26132025-03-22T05:05:08.219ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
26142025-03-22T05:05:08.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152025-03-22T05:05:08.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
26162025-03-22T05:05:08.265ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26172025-03-22T05:05:08.265ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
26182025-03-22T05:05:08.287ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26192025-03-22T05:05:08.287ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
26202025-03-22T05:05:08.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212025-03-22T05:05:08.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
26222025-03-22T05:05:08.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232025-03-22T05:05:08.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
26242025-03-22T05:05:08.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43935 req_id = e5a53c58-e4ad-4150-a0d4-78cbebc8e522 response_code = 200 uri = /inventory
26252025-03-22T05:05:08.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41519
26262025-03-22T05:05:08.412ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26272025-03-22T05:05:08.412ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26282025-03-22T05:05:08.412ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26292025-03-22T05:05:08.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26302025-03-22T05:05:08.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26312025-03-22T05:05:08.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26322025-03-22T05:05:08.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26332025-03-22T05:05:08.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41519 req_id = 510f0295-44a2-44d2-8432-ebfe7be9b9d9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26342025-03-22T05:05:08.414ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1021
26352025-03-22T05:05:08.418ZINFOSledAgent (RSS): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
26362025-03-22T05:05:08.418ZINFOSledAgent (RSS): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
26372025-03-22T05:05:08.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59377
26382025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26392025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26402025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26412025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26422025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26432025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26442025-03-22T05:05:08.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26452025-03-22T05:05:08.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59377 req_id = 5d00468d-8351-40b8-b6b5-a45e5402f197 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26462025-03-22T05:05:08.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41255
26472025-03-22T05:05:08.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26482025-03-22T05:05:08.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26492025-03-22T05:05:08.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
26502025-03-22T05:05:08.915ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
26512025-03-22T05:05:08.927ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-03-22T05:05:08.927ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
26532025-03-22T05:05:08.951ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26542025-03-22T05:05:08.951ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
26552025-03-22T05:05:08.972ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26562025-03-22T05:05:08.972ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
26572025-03-22T05:05:08.993ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582025-03-22T05:05:08.993ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
26592025-03-22T05:05:09.019ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-03-22T05:05:09.019ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
26612025-03-22T05:05:09.042ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26622025-03-22T05:05:09.042ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
26632025-03-22T05:05:09.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26642025-03-22T05:05:09.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
26652025-03-22T05:05:09.083ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26662025-03-22T05:05:09.083ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
26672025-03-22T05:05:09.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26682025-03-22T05:05:09.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
26692025-03-22T05:05:09.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41255 req_id = ce9a12c0-2b49-421b-b437-6f17f6968e3f response_code = 200 uri = /inventory
26702025-03-22T05:05:11.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50577
26712025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26722025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26732025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26742025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26752025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26762025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26772025-03-22T05:05:11.535ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782025-03-22T05:05:11.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50577 req_id = 5c78281c-b22e-44e6-9f82-537dc968dbde response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26792025-03-22T05:05:11.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33410
26802025-03-22T05:05:11.569ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26812025-03-22T05:05:11.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26822025-03-22T05:05:11.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26832025-03-22T05:05:11.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26842025-03-22T05:05:11.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26852025-03-22T05:05:11.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26862025-03-22T05:05:11.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26872025-03-22T05:05:11.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33410 req_id = 2093c679-2915-4f06-bb7b-29763dc223af response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26882025-03-22T05:05:12.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58414
26892025-03-22T05:05:12.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58414 req_id = d374cb64-36f5-4f02-a39e-9b7b7f47d518 response_code = 200 uri = /vpc-routes
26902025-03-22T05:05:12.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53066
26912025-03-22T05:05:12.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53066 req_id = b782b186-af87-4270-853e-def658791de0 response_code = 200 uri = /vpc-routes
26922025-03-22T05:05:12.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
26932025-03-22T05:05:12.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58414 req_id = ad33619c-a3c4-4eea-900a-a839c08c58da response_code = 204 uri = /eip-gateways
26942025-03-22T05:05:12.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56919
26952025-03-22T05:05:12.810ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
26962025-03-22T05:05:12.810ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
26972025-03-22T05:05:12.810ZINFOSledAgent (ArtifactStore): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/.artifact-config.json.tmp file = common/src/ledger.rs:197 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
26982025-03-22T05:05:12.812ZINFOSledAgent (ArtifactStore): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/.artifact-config.json.tmp file = common/src/ledger.rs:197 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
26992025-03-22T05:05:12.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56919 req_id = 2af53bcf-8b12-401c-893e-a2864900c078 response_code = 204 uri = /artifacts-config
27002025-03-22T05:05:12.814ZINFOSledAgent (ArtifactStore): Starting delete reconciler file = sled-agent/src/artifact_store.rs:521 generation = 1 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
27012025-03-22T05:05:12.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27022025-03-22T05:05:12.815ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27032025-03-22T05:05:12.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56919 req_id = 5d5e0489-66e9-4069-94c7-8ec7d4f894ca response_code = 200 uri = /artifacts
27042025-03-22T05:05:12.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33520
27052025-03-22T05:05:12.836ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
27062025-03-22T05:05:12.836ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
27072025-03-22T05:05:12.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
27082025-03-22T05:05:12.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33520 req_id = 6f528f3e-3530-4386-9864-b86868e5c936 response_code = 204 uri = /artifacts-config
27092025-03-22T05:05:12.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53066 req_id = 1c33527f-75b8-4e5b-ad50-a7f04f97e65c response_code = 204 uri = /eip-gateways
27102025-03-22T05:05:12.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27112025-03-22T05:05:12.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33520 req_id = 724d0649-5da6-4a16-beee-c5981e083412 response_code = 200 uri = /artifacts
27122025-03-22T05:05:12.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39263
27132025-03-22T05:05:12.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27142025-03-22T05:05:12.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27152025-03-22T05:05:12.852ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
27162025-03-22T05:05:12.853ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
27172025-03-22T05:05:12.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47182
27182025-03-22T05:05:12.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
27192025-03-22T05:05:12.872ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-03-22T05:05:12.872ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
27212025-03-22T05:05:12.910ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27222025-03-22T05:05:12.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
27232025-03-22T05:05:12.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56026
27242025-03-22T05:05:12.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34612
27252025-03-22T05:05:12.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34612 req_id = 7dee51b6-9f3c-4c1a-8796-64ebbad75d49 response_code = 200 uri = /v2p
27262025-03-22T05:05:12.943ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27272025-03-22T05:05:12.943ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
27282025-03-22T05:05:12.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55561
27292025-03-22T05:05:12.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55561 req_id = 2c374a6e-1453-488b-a383-d6f1e5d9c624 response_code = 200 uri = /v2p
27302025-03-22T05:05:12.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27312025-03-22T05:05:12.978ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
27322025-03-22T05:05:13.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27332025-03-22T05:05:13.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
27342025-03-22T05:05:13.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
27352025-03-22T05:05:13.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33069
27362025-03-22T05:05:13.039ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27372025-03-22T05:05:13.039ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27382025-03-22T05:05:13.039ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
27392025-03-22T05:05:13.045ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
27402025-03-22T05:05:13.054ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412025-03-22T05:05:13.054ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
27422025-03-22T05:05:13.078ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27432025-03-22T05:05:13.078ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
27442025-03-22T05:05:13.116ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27452025-03-22T05:05:13.116ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
27462025-03-22T05:05:13.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
27472025-03-22T05:05:13.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47182 req_id = 880e485b-fb82-4ea5-9ad4-61bbf352c3b8 response_code = 204 uri = /switch-ports
27482025-03-22T05:05:13.136ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27492025-03-22T05:05:13.136ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
27502025-03-22T05:05:13.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12083 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47182 req_id = 4648ad98-d28b-4e41-a41b-def4dc62c212 response_code = 200 uri = /network-bootstore-config
27512025-03-22T05:05:13.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58414 req_id = 13e3f687-1f0c-4503-a0d5-935c47283ea5 response_code = 204 uri = /vpc-routes
27522025-03-22T05:05:13.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27532025-03-22T05:05:13.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
27542025-03-22T05:05:13.186ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27552025-03-22T05:05:13.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
27562025-03-22T05:05:13.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48876
27572025-03-22T05:05:13.197ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27582025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27592025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27602025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27612025-03-22T05:05:13.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
27622025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27632025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27642025-03-22T05:05:13.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27652025-03-22T05:05:13.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6575 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48876 req_id = 9b03d83b-0488-42cd-8f9a-184fb8d8ecf8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27662025-03-22T05:05:13.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27672025-03-22T05:05:13.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
27682025-03-22T05:05:13.244ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
27692025-03-22T05:05:13.249ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
27702025-03-22T05:05:13.254ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27712025-03-22T05:05:13.254ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
27722025-03-22T05:05:13.261ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
27732025-03-22T05:05:13.263ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
27742025-03-22T05:05:13.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29019 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47182 req_id = 6fc18a81-40e0-4e27-9444-49ef2f03fd2d response_code = 204 uri = /network-bootstore-config
27752025-03-22T05:05:13.273ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27762025-03-22T05:05:13.273ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
27772025-03-22T05:05:13.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 439460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39263 req_id = 6d6f4169-a0fe-411f-b702-c1ec9843ff24 response_code = 200 uri = /inventory
27782025-03-22T05:05:13.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27792025-03-22T05:05:13.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
27802025-03-22T05:05:13.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 366379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56026 req_id = 8e346b03-c950-4d37-a81c-0fb17d1ed139 response_code = 204 uri = /switch-ports
27812025-03-22T05:05:13.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56026 req_id = 34eb1e11-36d1-400a-bddf-8fc762a3ac8b response_code = 200 uri = /network-bootstore-config
27822025-03-22T05:05:13.330ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27832025-03-22T05:05:13.330ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
27842025-03-22T05:05:13.335ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
27852025-03-22T05:05:13.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53066 req_id = 8e5551b2-f69b-498d-b9ed-c732fcf121ab response_code = 204 uri = /vpc-routes
27862025-03-22T05:05:13.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-03-22T05:05:13.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
27882025-03-22T05:05:13.394ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27892025-03-22T05:05:13.394ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
27902025-03-22T05:05:13.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56716
27912025-03-22T05:05:13.405ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27922025-03-22T05:05:13.405ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27932025-03-22T05:05:13.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942025-03-22T05:05:13.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27952025-03-22T05:05:13.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27962025-03-22T05:05:13.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27972025-03-22T05:05:13.406ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27982025-03-22T05:05:13.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56716 req_id = 9968c55d-2aa6-4b79-8b2b-9fb71387515b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27992025-03-22T05:05:13.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 388641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33069 req_id = 649784e0-320b-45b9-938a-a76c2dd4c610 response_code = 200 uri = /inventory
28002025-03-22T05:05:16.719ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
28012025-03-22T05:05:16.720ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
28022025-03-22T05:05:16.720ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
28032025-03-22T05:05:16.723ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
28042025-03-22T05:05:18.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37305
28052025-03-22T05:05:18.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37305 req_id = 6b82edf9-6c9c-45a4-a6e5-a4b6f2c6cfd2 response_code = 200 uri = /vpc-routes
28062025-03-22T05:05:18.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28072025-03-22T05:05:18.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37305 req_id = d20ea3c6-07de-4739-80ff-b5fd426d7042 response_code = 204 uri = /eip-gateways
28082025-03-22T05:05:18.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37305 req_id = 11be8610-2c58-484c-bc0a-d376f3b80e82 response_code = 204 uri = /vpc-routes
28092025-03-22T05:05:22.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62949
28102025-03-22T05:05:22.997ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62949 req_id = 122cc0db-b080-46b9-9050-51232fa1c62d response_code = 200 uri = /baseboard
28112025-03-22T05:05:37.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52613
28122025-03-22T05:05:37.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52613 req_id = 80a7bfed-5d59-4be2-9055-1297e2fae8f2 response_code = 200 uri = /vpc-routes
28132025-03-22T05:05:37.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28142025-03-22T05:05:37.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52613 req_id = d0a889b0-3937-4f5f-a327-22a00be03289 response_code = 204 uri = /eip-gateways
28152025-03-22T05:05:37.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52613 req_id = 658c62ba-263e-464b-a633-b889d1e74bf4 response_code = 204 uri = /vpc-routes
28162025-03-22T05:05:37.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60235
28172025-03-22T05:05:37.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28182025-03-22T05:05:37.191ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28192025-03-22T05:05:37.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60235 req_id = b5304fbe-2bcd-409a-b6c4-9c2d9724356f response_code = 204 uri = /switch-ports
28202025-03-22T05:05:37.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62670
28212025-03-22T05:05:37.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62670 req_id = ec0a4b06-a078-4e23-b4df-eeec75a71fb8 response_code = 200 uri = /v2p
28222025-03-22T05:05:37.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60235 req_id = 338b7f58-6659-4c67-be09-7f3b4047b06e response_code = 200 uri = /network-bootstore-config
28232025-03-22T05:05:41.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41679
28242025-03-22T05:05:41.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41679 req_id = 658b5b4d-103f-4cf5-bdad-a3c03607a658 response_code = 200 uri = /vpc-routes
28252025-03-22T05:05:41.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28262025-03-22T05:05:41.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41679 req_id = 268877f8-02c6-4398-a359-e4a77861f3ad response_code = 204 uri = /eip-gateways
28272025-03-22T05:05:42.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56958
28282025-03-22T05:05:42.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56958 req_id = 8948ea6c-3c93-4c72-a6e4-372c90834e3a response_code = 200 uri = /v2p
28292025-03-22T05:05:42.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41679 req_id = a4c03156-9809-47bb-8286-019ee52871a3 response_code = 204 uri = /vpc-routes
28302025-03-22T05:05:42.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43923
28312025-03-22T05:05:42.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 5abcb352-f8c4-47cc-b48e-58fa9ffb873c response_code = 200 uri = /vpc-routes
28322025-03-22T05:05:42.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44271
28332025-03-22T05:05:42.135ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28342025-03-22T05:05:42.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28352025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44271 req_id = 8ea284bd-9a66-4c9e-9d16-44d5571e9994 response_code = 204 uri = /switch-ports
28362025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54507
28372025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47196
28382025-03-22T05:05:42.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28392025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43923 req_id = b8422adf-2196-41e0-9555-b7ea25520fd3 response_code = 204 uri = /eip-gateways
28402025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54507 req_id = 9a5aa3f6-c155-459f-b063-d1fcdfba720b response_code = 200 uri = /v2p
28412025-03-22T05:05:42.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44271 req_id = f0944373-baa6-40fc-8656-0dbeb43b1cd4 response_code = 200 uri = /network-bootstore-config
28422025-03-22T05:05:42.230ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28432025-03-22T05:05:42.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 736335f2-a857-40ea-9279-b6ca22ffb1ea response_code = 204 uri = /vpc-routes
28442025-03-22T05:05:42.265ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28452025-03-22T05:05:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47196 req_id = 33826ef4-134b-4cfa-b957-96da615e306e response_code = 204 uri = /switch-ports
28462025-03-22T05:05:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47196 req_id = 961b8db4-46a4-40e9-b236-431f7fb632d4 response_code = 200 uri = /network-bootstore-config
28472025-03-22T05:05:53.031ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60387
28482025-03-22T05:05:53.031ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60387 req_id = 6c538e36-fada-4f86-adb4-e5dfc7dd2c42 response_code = 200 uri = /baseboard
28492025-03-22T05:06:07.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59389
28502025-03-22T05:06:07.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59389 req_id = d3437318-58b2-4675-8dee-8f34fbb9028b response_code = 200 uri = /vpc-routes
28512025-03-22T05:06:07.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52188
28522025-03-22T05:06:07.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52188 req_id = 0b696934-e946-41b3-88b9-bd93338a4bdf response_code = 200 uri = /v2p
28532025-03-22T05:06:07.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28542025-03-22T05:06:07.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59389 req_id = 8f967f67-cfef-4f9c-84ed-ce9b659bcb39 response_code = 204 uri = /eip-gateways
28552025-03-22T05:06:07.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59389 req_id = 9f90b063-1c71-41d6-ac1d-4d836ecadc93 response_code = 204 uri = /vpc-routes
28562025-03-22T05:06:07.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61202
28572025-03-22T05:06:07.343ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28582025-03-22T05:06:07.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28592025-03-22T05:06:07.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61202 req_id = 645e17de-f6bf-47cb-852f-7126b6d6c7b2 response_code = 204 uri = /switch-ports
28602025-03-22T05:06:07.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61202 req_id = c11d053d-bdda-4fb6-8e9d-45f817c62ca9 response_code = 200 uri = /network-bootstore-config
28612025-03-22T05:06:12.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51462
28622025-03-22T05:06:12.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51462 req_id = 897f2bd1-7a02-47bb-a24e-981319fe7db6 response_code = 200 uri = /vpc-routes
28632025-03-22T05:06:12.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28642025-03-22T05:06:12.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51462 req_id = 12461f03-9001-4439-86a9-347d29351a51 response_code = 204 uri = /eip-gateways
28652025-03-22T05:06:12.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51462 req_id = bc30a4b9-bbea-477f-b7aa-41c2d2a17c35 response_code = 204 uri = /vpc-routes
28662025-03-22T05:06:12.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50648
28672025-03-22T05:06:12.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50648 req_id = ddcf7632-b61b-43e8-a83b-de9b9427d174 response_code = 200 uri = /vpc-routes
28682025-03-22T05:06:12.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56847
28692025-03-22T05:06:12.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56847 req_id = f44db26c-e28a-4725-9c11-b9d45f7f7e4f response_code = 200 uri = /v2p
28702025-03-22T05:06:12.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34350
28712025-03-22T05:06:12.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34350 req_id = 2cb3c86e-a6a9-4498-837c-da8ee19310c5 response_code = 200 uri = /v2p
28722025-03-22T05:06:12.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59742
28732025-03-22T05:06:12.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28742025-03-22T05:06:12.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28752025-03-22T05:06:12.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59742 req_id = f981005b-faa4-47c3-9d5b-a672cbcbfce6 response_code = 204 uri = /switch-ports
28762025-03-22T05:06:12.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28772025-03-22T05:06:12.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50648 req_id = 980fddb3-c987-47cf-951a-cb7b4a75feba response_code = 204 uri = /eip-gateways
28782025-03-22T05:06:12.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59742 req_id = 4e0e0ca8-c515-436a-bffb-cb67ca9009d1 response_code = 200 uri = /network-bootstore-config
28792025-03-22T05:06:12.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50648 req_id = ff36664d-5e5d-43b9-91ae-c6f4dfc20312 response_code = 204 uri = /vpc-routes
28802025-03-22T05:06:12.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42844
28812025-03-22T05:06:12.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28822025-03-22T05:06:12.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28832025-03-22T05:06:12.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42844 req_id = 52dba474-c45c-43c1-8e81-49ffb7b554d3 response_code = 204 uri = /switch-ports
28842025-03-22T05:06:12.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42844 req_id = 022ad1f5-3daf-460d-bef5-a6b9287c0202 response_code = 200 uri = /network-bootstore-config
28852025-03-22T05:06:16.720ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
28862025-03-22T05:06:16.720ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
28872025-03-22T05:06:16.720ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
28882025-03-22T05:06:16.720ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
28892025-03-22T05:06:23.070ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64658
28902025-03-22T05:06:23.070ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64658 req_id = 00ddf470-cabe-4cf9-89c3-e0f942b37eaa response_code = 200 uri = /baseboard
28912025-03-22T05:06:37.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62513
28922025-03-22T05:06:37.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62513 req_id = fc081668-5539-4d4c-b8ff-d2aab521893f response_code = 200 uri = /vpc-routes
28932025-03-22T05:06:37.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
28942025-03-22T05:06:37.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62513 req_id = b6a6fc42-ac58-451f-a68d-f254a69b460a response_code = 204 uri = /eip-gateways
28952025-03-22T05:06:37.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46540
28962025-03-22T05:06:37.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46540 req_id = 36829351-935f-43a4-898a-1245f41db79c response_code = 200 uri = /v2p
28972025-03-22T05:06:37.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62513 req_id = ca37c143-b0b0-4dad-af3a-bc964e4c4158 response_code = 204 uri = /vpc-routes
28982025-03-22T05:06:37.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48844
28992025-03-22T05:06:37.105ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29002025-03-22T05:06:37.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29012025-03-22T05:06:37.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115248 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48844 req_id = f6302590-b92e-43a8-a6c9-20548297998e response_code = 204 uri = /switch-ports
29022025-03-22T05:06:37.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48844 req_id = 885fefa1-3309-4052-9db7-422cee73e707 response_code = 200 uri = /network-bootstore-config
29032025-03-22T05:06:39.765ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:35639 remote_addr = [fd00:1122:3344:101::d]:47725 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
29042025-03-22T05:06:39.800ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35175 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = d772fa6a-29a7-4513-9d1f-139e33e76098 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
29052025-03-22T05:06:41.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39474
29062025-03-22T05:06:41.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39474 req_id = 040c2227-dcfa-48b8-b2f8-bef58188f096 response_code = 200 uri = /vpc-routes
29072025-03-22T05:06:41.946ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29082025-03-22T05:06:41.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39474 req_id = 67d22052-3ae0-44fb-9de0-2a583019d618 response_code = 204 uri = /eip-gateways
29092025-03-22T05:06:41.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39474 req_id = 4e65dd59-ffbd-4219-a61e-366718d763af response_code = 204 uri = /vpc-routes
29102025-03-22T05:06:42.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52384
29112025-03-22T05:06:42.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52384 req_id = ed4b11f8-d956-47c3-bafc-4de182a8f0a6 response_code = 200 uri = /v2p
29122025-03-22T05:06:42.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36127
29132025-03-22T05:06:42.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29142025-03-22T05:06:42.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29152025-03-22T05:06:42.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36127 req_id = 547008ae-6645-41d3-b476-c89d3e1d0aa1 response_code = 204 uri = /switch-ports
29162025-03-22T05:06:42.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53237
29172025-03-22T05:06:42.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33695
29182025-03-22T05:06:42.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53237 req_id = b3619a2e-5b5b-449f-8406-92985212b266 response_code = 200 uri = /vpc-routes
29192025-03-22T05:06:42.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36127 req_id = 3c31c2c3-bda3-42e9-9526-be35715d91cb response_code = 200 uri = /network-bootstore-config
29202025-03-22T05:06:42.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33695 req_id = daf2514a-d4c5-42a4-86d3-f34c40ce9843 response_code = 200 uri = /v2p
29212025-03-22T05:06:42.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29222025-03-22T05:06:42.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53237 req_id = d2561f0e-e715-41c2-bada-4f480ef859be response_code = 204 uri = /eip-gateways
29232025-03-22T05:06:42.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54921
29242025-03-22T05:06:42.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29252025-03-22T05:06:42.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29262025-03-22T05:06:42.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54921 req_id = edc656ef-df9f-4ce5-966a-5301af603f86 response_code = 204 uri = /switch-ports
29272025-03-22T05:06:42.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54921 req_id = 76d2d449-a38e-460b-874f-9b2e678c7e17 response_code = 200 uri = /network-bootstore-config
29282025-03-22T05:06:42.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53237 req_id = 08a80b53-3063-4ac8-8e55-5f6ef7283561 response_code = 204 uri = /vpc-routes
29292025-03-22T05:06:53.104ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62853
29302025-03-22T05:06:53.104ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62853 req_id = 6ea3ca52-5ebe-402d-9cc2-cfc27f7d5b94 response_code = 200 uri = /baseboard
29312025-03-22T05:07:07.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39644
29322025-03-22T05:07:07.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 5ad6dfb9-51c6-44bc-ac8f-5d5f4f83385c response_code = 200 uri = /vpc-routes
29332025-03-22T05:07:07.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29342025-03-22T05:07:07.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39644 req_id = f4811f6f-892f-44fd-9d3e-5b41c9317228 response_code = 204 uri = /eip-gateways
29352025-03-22T05:07:07.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 8ebe7522-8bed-41c0-a0c1-9ed6daf1c01a response_code = 204 uri = /vpc-routes
29362025-03-22T05:07:07.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64507
29372025-03-22T05:07:07.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64507 req_id = a78b3dd0-60f3-419f-aae0-c6c82ab6e25c response_code = 200 uri = /v2p
29382025-03-22T05:07:07.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55149
29392025-03-22T05:07:07.399ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29402025-03-22T05:07:07.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29412025-03-22T05:07:07.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55149 req_id = 4fe748fd-c470-4ef7-ba3c-8729b4cb055d response_code = 204 uri = /switch-ports
29422025-03-22T05:07:07.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55149 req_id = 42a86f9c-fba6-4579-91e0-3fe5b23c071b response_code = 200 uri = /network-bootstore-config
29432025-03-22T05:07:09.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7353 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 61190319-135c-4899-a1ee-b35a73e825e8 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
29442025-03-22T05:07:12.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58769
29452025-03-22T05:07:12.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58769 req_id = 7e46567b-b053-44fd-9476-e6e0aae468ba response_code = 200 uri = /v2p
29462025-03-22T05:07:12.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53181
29472025-03-22T05:07:12.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53181 req_id = 82929fca-5931-4658-b65b-2c18cf8ce5cd response_code = 200 uri = /vpc-routes
29482025-03-22T05:07:12.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58139
29492025-03-22T05:07:12.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58139 req_id = a1aa92ca-dfd0-4d76-8979-44844f2563dd response_code = 200 uri = /vpc-routes
29502025-03-22T05:07:12.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29512025-03-22T05:07:12.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53181 req_id = c2e05e79-8d90-46e8-9351-e0a0e1357866 response_code = 204 uri = /eip-gateways
29522025-03-22T05:07:12.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29532025-03-22T05:07:12.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58139 req_id = 483a936e-018d-4729-a689-0f67f8215f12 response_code = 204 uri = /eip-gateways
29542025-03-22T05:07:12.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53181 req_id = 1d9bd158-823f-4284-93fb-73d519c0be13 response_code = 204 uri = /vpc-routes
29552025-03-22T05:07:12.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58139 req_id = da1bea1e-7544-482c-a87d-dd5c361715eb response_code = 204 uri = /vpc-routes
29562025-03-22T05:07:12.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43039
29572025-03-22T05:07:12.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43039 req_id = acf73103-a151-4ae1-859c-50bb5bea3cd0 response_code = 200 uri = /v2p
29582025-03-22T05:07:12.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41731
29592025-03-22T05:07:12.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29602025-03-22T05:07:12.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29612025-03-22T05:07:12.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94449 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41731 req_id = d9ab4df7-c71e-4ed8-9338-9bf1ddfe7d17 response_code = 204 uri = /switch-ports
29622025-03-22T05:07:12.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52500
29632025-03-22T05:07:12.479ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29642025-03-22T05:07:12.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41731 req_id = 79865b52-2e1b-4ac7-8f1f-13b46d2cd76e response_code = 200 uri = /network-bootstore-config
29652025-03-22T05:07:12.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29662025-03-22T05:07:12.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89389 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52500 req_id = 9693ac2c-0c78-4464-a2f3-aaa63d28143d response_code = 204 uri = /switch-ports
29672025-03-22T05:07:12.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52500 req_id = fae828b2-720f-46dc-ad0c-7d5c82a514c4 response_code = 200 uri = /network-bootstore-config
29682025-03-22T05:07:16.720ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
29692025-03-22T05:07:16.721ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
29702025-03-22T05:07:16.721ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
29712025-03-22T05:07:16.721ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
29722025-03-22T05:07:23.137ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43199
29732025-03-22T05:07:23.137ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43199 req_id = 234bec24-c307-43f8-a6f2-68559c4222b5 response_code = 200 uri = /baseboard
29742025-03-22T05:07:36.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63470
29752025-03-22T05:07:36.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63470 req_id = efe8c390-c3fb-432e-a6ff-f174f083bed0 response_code = 200 uri = /vpc-routes
29762025-03-22T05:07:37.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45948
29772025-03-22T05:07:37.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29782025-03-22T05:07:37.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29792025-03-22T05:07:37.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99230 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45948 req_id = b307117f-1ec9-4ff5-b629-eded3a408764 response_code = 204 uri = /switch-ports
29802025-03-22T05:07:37.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29812025-03-22T05:07:37.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63470 req_id = 8ee05470-fa38-4c5f-8c2f-a1cb1f80ddc0 response_code = 204 uri = /eip-gateways
29822025-03-22T05:07:37.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45948 req_id = a76bdd66-913d-4d39-ab41-4de0cd292dc3 response_code = 200 uri = /network-bootstore-config
29832025-03-22T05:07:37.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63470 req_id = ad16aa7d-b913-4924-8ab9-01954f195912 response_code = 204 uri = /vpc-routes
29842025-03-22T05:07:37.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57403
29852025-03-22T05:07:37.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57403 req_id = 5687bbb4-acef-45a5-b088-6d70023298b1 response_code = 200 uri = /v2p
29862025-03-22T05:07:39.771ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6413 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 86270230-7c71-49c1-ab35-e923d61ebcd0 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
29872025-03-22T05:07:41.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60830
29882025-03-22T05:07:41.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60830 req_id = 11cc6218-9f2a-4a91-8350-7929679c44b0 response_code = 200 uri = /vpc-routes
29892025-03-22T05:07:41.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
29902025-03-22T05:07:41.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60830 req_id = bc70918a-eb71-4fdc-8189-b70d80b110d7 response_code = 204 uri = /eip-gateways
29912025-03-22T05:07:41.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60107
29922025-03-22T05:07:41.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60107 req_id = 441b2e75-0cec-4d79-ae17-aa36d5461ad3 response_code = 200 uri = /v2p
29932025-03-22T05:07:41.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60830 req_id = 68feb2ce-4386-47aa-82e8-67cf2849f087 response_code = 204 uri = /vpc-routes
29942025-03-22T05:07:41.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51901
29952025-03-22T05:07:41.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51901 req_id = 1162fd72-cc9b-426f-975d-4bffcc0758db response_code = 200 uri = /vpc-routes
29962025-03-22T05:07:41.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61149
29972025-03-22T05:07:41.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29982025-03-22T05:07:42.002ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29992025-03-22T05:07:42.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61149 req_id = 8e72a114-899e-4d67-908d-0bc9c234eb61 response_code = 204 uri = /switch-ports
30002025-03-22T05:07:42.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30012025-03-22T05:07:42.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51901 req_id = 6a97753a-1c1f-40ff-83d0-94ee91b7f580 response_code = 204 uri = /eip-gateways
30022025-03-22T05:07:42.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61149 req_id = 82cabb77-026d-4bf1-a383-ee9b4b0e7184 response_code = 200 uri = /network-bootstore-config
30032025-03-22T05:07:42.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51901 req_id = 3d00d00c-c8d7-4c41-b5e1-9db60b9419df response_code = 204 uri = /vpc-routes
30042025-03-22T05:07:42.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47779
30052025-03-22T05:07:42.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47779 req_id = b5dc8660-d8f6-410f-9489-e1b36a46024a response_code = 200 uri = /v2p
30062025-03-22T05:07:42.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34767
30072025-03-22T05:07:42.112ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30082025-03-22T05:07:42.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30092025-03-22T05:07:42.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34767 req_id = 8e5a9349-11a9-4580-91ea-64ec5325768e response_code = 204 uri = /switch-ports
30102025-03-22T05:07:42.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34767 req_id = 02f08032-3ba4-46c1-b3a0-20d6bef40665 response_code = 200 uri = /network-bootstore-config
30112025-03-22T05:07:53.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36482
30122025-03-22T05:07:53.171ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36482 req_id = 701398a9-c86e-4303-9a2e-aa19019f269d response_code = 200 uri = /baseboard
30132025-03-22T05:08:07.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45934
30142025-03-22T05:08:07.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45934 req_id = 77032cb5-64a6-48d1-bcfd-4fb9ff4d9bab response_code = 200 uri = /vpc-routes
30152025-03-22T05:08:07.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44570
30162025-03-22T05:08:07.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44570 req_id = 14d69ef2-b9c8-4966-bf4f-588551be0ad7 response_code = 200 uri = /v2p
30172025-03-22T05:08:07.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30182025-03-22T05:08:07.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45934 req_id = 9ebb4c9d-942e-4f35-80bb-cbd8b7566996 response_code = 204 uri = /eip-gateways
30192025-03-22T05:08:07.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45934 req_id = 1a47a8a8-0c0f-4405-8d51-6680bc53fd5b response_code = 204 uri = /vpc-routes
30202025-03-22T05:08:07.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33051
30212025-03-22T05:08:07.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30222025-03-22T05:08:07.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30232025-03-22T05:08:07.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33051 req_id = a1b19b0a-a9c3-46c3-8f9a-bdfe5f09f2e7 response_code = 204 uri = /switch-ports
30242025-03-22T05:08:07.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33051 req_id = 03f1e6bf-c6d9-4362-b1c3-06ffc0d1bdf5 response_code = 200 uri = /network-bootstore-config
30252025-03-22T05:08:09.772ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6673 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = b3a13c71-9ed0-4293-b532-eafd095d6842 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
30262025-03-22T05:08:12.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59905
30272025-03-22T05:08:12.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59905 req_id = 2768d28f-41a1-4b55-adde-b25e9c73c96f response_code = 200 uri = /vpc-routes
30282025-03-22T05:08:12.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54576
30292025-03-22T05:08:12.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54576 req_id = 1f4d10c4-b715-4baa-96d5-5b35a3e8a874 response_code = 200 uri = /vpc-routes
30302025-03-22T05:08:12.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49031
30312025-03-22T05:08:12.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49031 req_id = e3f278ab-f2dd-467e-8868-198eceea143d response_code = 200 uri = /v2p
30322025-03-22T05:08:12.308ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30332025-03-22T05:08:12.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54576 req_id = 11822439-f86b-4e95-a25f-fb548c0cf5b8 response_code = 204 uri = /eip-gateways
30342025-03-22T05:08:12.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54576 req_id = eec0ce10-d2dc-4258-aa8a-b33243b3c66d response_code = 204 uri = /vpc-routes
30352025-03-22T05:08:12.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35718
30362025-03-22T05:08:12.331ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30372025-03-22T05:08:12.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30382025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35718 req_id = b0bbaa7b-e81b-4df8-a963-1bdac4c4df69 response_code = 204 uri = /switch-ports
30392025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40611
30402025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36325
30412025-03-22T05:08:12.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30422025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59905 req_id = 49739c18-2f58-4d3d-a835-2ff01cfd8a67 response_code = 204 uri = /eip-gateways
30432025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40611 req_id = 939a4cd5-efe3-4f84-8aee-de2cfeb0bdcc response_code = 200 uri = /v2p
30442025-03-22T05:08:12.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35718 req_id = dcf42682-7905-44bb-b53d-1c0b33267d14 response_code = 200 uri = /network-bootstore-config
30452025-03-22T05:08:12.432ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30462025-03-22T05:08:12.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59905 req_id = 186b9eb2-650a-4e89-bf18-8664181725a0 response_code = 204 uri = /vpc-routes
30472025-03-22T05:08:12.469ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30482025-03-22T05:08:12.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36325 req_id = 0d35be4e-6a36-4218-aacc-a47ba0876535 response_code = 204 uri = /switch-ports
30492025-03-22T05:08:12.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36325 req_id = 5e83b712-c13c-4143-b850-297e9dacf3f1 response_code = 200 uri = /network-bootstore-config
30502025-03-22T05:08:16.720ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
30512025-03-22T05:08:16.720ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
30522025-03-22T05:08:16.720ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
30532025-03-22T05:08:16.720ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
30542025-03-22T05:08:23.204ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51380
30552025-03-22T05:08:23.204ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51380 req_id = cce123c4-5055-4c27-b847-764027a0790f response_code = 200 uri = /baseboard
30562025-03-22T05:08:36.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38397
30572025-03-22T05:08:36.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38397 req_id = 832e7bed-b61d-4b98-98b4-d2a3056e3c51 response_code = 200 uri = /vpc-routes
30582025-03-22T05:08:36.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30592025-03-22T05:08:36.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38397 req_id = baf504bc-b52a-420e-bfb1-c20049db1211 response_code = 204 uri = /eip-gateways
30602025-03-22T05:08:36.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38397 req_id = fcfa2eef-8921-4742-bdbb-fcbf429749c8 response_code = 204 uri = /vpc-routes
30612025-03-22T05:08:37.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39972
30622025-03-22T05:08:37.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39972 req_id = 0dd001da-9961-4faa-9a1c-32fb0ac9c4ea response_code = 200 uri = /v2p
30632025-03-22T05:08:37.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56899
30642025-03-22T05:08:37.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30652025-03-22T05:08:37.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30662025-03-22T05:08:37.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56899 req_id = fc282feb-be22-41df-9515-6a3d9557c8f3 response_code = 204 uri = /switch-ports
30672025-03-22T05:08:37.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56899 req_id = 2ca23b1c-46c2-4bfc-b50f-d422c8d13b21 response_code = 200 uri = /network-bootstore-config
30682025-03-22T05:08:39.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7614 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 55737eac-7191-4ee2-b8ad-6a9c58b96682 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
30692025-03-22T05:08:41.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40350
30702025-03-22T05:08:41.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40350 req_id = a8e335d8-3229-4016-9ace-90858c2e979e response_code = 200 uri = /vpc-routes
30712025-03-22T05:08:41.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30722025-03-22T05:08:41.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40350 req_id = 4f1eaf5f-76f6-45d4-9317-868f2baf4aa8 response_code = 204 uri = /eip-gateways
30732025-03-22T05:08:41.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33920
30742025-03-22T05:08:41.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33920 req_id = 4b9b6e08-5cdf-49c0-9976-a3fcc1345cc6 response_code = 200 uri = /vpc-routes
30752025-03-22T05:08:41.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50543
30762025-03-22T05:08:41.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50543 req_id = f1317c4e-b87a-44d7-b24a-04c863e0ced7 response_code = 200 uri = /v2p
30772025-03-22T05:08:41.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40350 req_id = 9fb729ed-b92e-47c0-95b1-3510c175daf2 response_code = 204 uri = /vpc-routes
30782025-03-22T05:08:42.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30792025-03-22T05:08:42.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33920 req_id = 21b5dca6-59b9-4d71-b54e-efddd46e0420 response_code = 204 uri = /eip-gateways
30802025-03-22T05:08:42.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33920 req_id = f55d2a22-a9c0-459b-988d-0882f4e72d8a response_code = 204 uri = /vpc-routes
30812025-03-22T05:08:42.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44806
30822025-03-22T05:08:42.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30832025-03-22T05:08:42.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30842025-03-22T05:08:42.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108947 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44806 req_id = 423edad9-6365-4204-8e3c-a9af2c00fddf response_code = 204 uri = /switch-ports
30852025-03-22T05:08:42.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53207
30862025-03-22T05:08:42.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30872025-03-22T05:08:42.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30882025-03-22T05:08:42.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95152 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53207 req_id = dd15d452-fcfb-418e-b7ad-d1ed96e72f2e response_code = 204 uri = /switch-ports
30892025-03-22T05:08:42.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53109
30902025-03-22T05:08:42.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44806 req_id = a55ea2f2-6ee8-418c-bb51-252134039a0f response_code = 200 uri = /network-bootstore-config
30912025-03-22T05:08:42.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53207 req_id = d0c68dc9-1f87-4fb0-b9af-ab67d946a3c3 response_code = 200 uri = /network-bootstore-config
30922025-03-22T05:08:42.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53109 req_id = 76e383ac-6dba-4e51-92eb-37eb8da8f5c0 response_code = 200 uri = /v2p
30932025-03-22T05:08:53.241ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34765
30942025-03-22T05:08:53.241ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34765 req_id = a1c5d982-8cd1-4759-81c0-d715918b9ac0 response_code = 200 uri = /baseboard
30952025-03-22T05:09:07.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41448
30962025-03-22T05:09:07.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41448 req_id = 0657fcce-81f6-4bea-be42-2a3916f1c7ef response_code = 200 uri = /vpc-routes
30972025-03-22T05:09:07.174ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
30982025-03-22T05:09:07.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41448 req_id = b83e27d4-1569-45d6-9502-8391c43f1b13 response_code = 204 uri = /eip-gateways
30992025-03-22T05:09:07.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41448 req_id = d72eb8da-13a3-40f9-80a6-f891dd77f3ac response_code = 204 uri = /vpc-routes
31002025-03-22T05:09:07.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40808
31012025-03-22T05:09:07.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40808 req_id = b315bf52-cd42-4f68-b87e-79ec5ca763b0 response_code = 200 uri = /v2p
31022025-03-22T05:09:07.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61730
31032025-03-22T05:09:07.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31042025-03-22T05:09:07.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31052025-03-22T05:09:07.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61730 req_id = 69e846ed-a54b-47a5-bdaf-5f831e92b0d7 response_code = 204 uri = /switch-ports
31062025-03-22T05:09:07.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61730 req_id = 6432c2b8-8de0-42c1-847a-789cdf71f4f3 response_code = 200 uri = /network-bootstore-config
31072025-03-22T05:09:09.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7258 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = eed3e9b6-3121-4a60-8b76-56c9d316bd5e response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
31082025-03-22T05:09:12.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44390
31092025-03-22T05:09:12.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44390 req_id = c993a347-6a50-4d3f-93b2-9c26c967356e response_code = 200 uri = /vpc-routes
31102025-03-22T05:09:12.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48728
31112025-03-22T05:09:12.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48728 req_id = 21c536d2-24fa-45a1-b1c9-b1d1a25c8859 response_code = 200 uri = /vpc-routes
31122025-03-22T05:09:12.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31132025-03-22T05:09:12.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44390 req_id = a3dc02eb-cf0f-4983-a0a4-62f6044a5e88 response_code = 204 uri = /eip-gateways
31142025-03-22T05:09:12.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31152025-03-22T05:09:12.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48728 req_id = d1db0e93-f5bd-4b77-96ed-0286f1e4e6a2 response_code = 204 uri = /eip-gateways
31162025-03-22T05:09:12.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48728 req_id = 6fe985df-fa8c-4cf8-aaed-37d611d41538 response_code = 204 uri = /vpc-routes
31172025-03-22T05:09:12.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52900
31182025-03-22T05:09:12.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52900 req_id = 28b92b3b-a293-4fdb-b9e6-241a43080ada response_code = 200 uri = /v2p
31192025-03-22T05:09:12.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44390 req_id = 1689ae7a-1600-4de0-b66b-87e347e8591c response_code = 204 uri = /vpc-routes
31202025-03-22T05:09:12.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40264
31212025-03-22T05:09:12.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31222025-03-22T05:09:12.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31232025-03-22T05:09:12.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40264 req_id = 3a963848-b288-49ce-9a68-655ca94c630b response_code = 204 uri = /switch-ports
31242025-03-22T05:09:12.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61529
31252025-03-22T05:09:12.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55254
31262025-03-22T05:09:12.434ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31272025-03-22T05:09:12.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61529 req_id = f20b82a3-d7bb-4fc6-90aa-42a3d487bae0 response_code = 200 uri = /v2p
31282025-03-22T05:09:12.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40264 req_id = 0d4e00b8-62cc-40cd-a917-78a9d6380df8 response_code = 200 uri = /network-bootstore-config
31292025-03-22T05:09:12.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31302025-03-22T05:09:12.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55254 req_id = ba6b557b-8bfa-424b-bd2f-539ef4bd6bfd response_code = 204 uri = /switch-ports
31312025-03-22T05:09:12.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55254 req_id = cd8fa9a8-17fa-440f-b896-f2b206749402 response_code = 200 uri = /network-bootstore-config
31322025-03-22T05:09:16.720ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
31332025-03-22T05:09:16.721ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
31342025-03-22T05:09:16.721ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
31352025-03-22T05:09:16.721ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
31362025-03-22T05:09:22.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
31372025-03-22T05:09:23.274ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53309
31382025-03-22T05:09:23.275ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53309 req_id = 07d5ecb0-41dc-4d5d-9a13-6b43489a4089 response_code = 200 uri = /baseboard
31392025-03-22T05:09:37.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48750
31402025-03-22T05:09:37.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48750 req_id = 267e1555-d68b-430b-a54b-f45a0fb1e984 response_code = 200 uri = /vpc-routes
31412025-03-22T05:09:37.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31422025-03-22T05:09:37.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48750 req_id = d6a52186-a2c1-4642-aab5-d1fb426d9d5d response_code = 204 uri = /eip-gateways
31432025-03-22T05:09:37.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48750 req_id = 954841e6-1031-4f92-b469-7acb2d6bde1e response_code = 204 uri = /vpc-routes
31442025-03-22T05:09:37.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60940
31452025-03-22T05:09:37.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60940 req_id = e6db6111-1985-44de-bb6c-8afd17c38798 response_code = 200 uri = /v2p
31462025-03-22T05:09:37.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54298
31472025-03-22T05:09:37.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31482025-03-22T05:09:37.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31492025-03-22T05:09:37.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54298 req_id = 8856e388-42cf-4472-9f3c-906b0a34c12f response_code = 204 uri = /switch-ports
31502025-03-22T05:09:37.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54298 req_id = 85f38783-6bed-4eb9-beb0-43c9ad08aada response_code = 200 uri = /network-bootstore-config
31512025-03-22T05:09:39.774ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8484 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 43827bc3-789b-4221-b651-84dda0a5502f response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
31522025-03-22T05:09:41.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51312
31532025-03-22T05:09:41.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51312 req_id = d4eed03f-219e-4322-87f8-0f3957870751 response_code = 200 uri = /vpc-routes
31542025-03-22T05:09:41.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31552025-03-22T05:09:41.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51312 req_id = aa77a9d4-f2aa-44b4-9bac-e9e91d53868f response_code = 204 uri = /eip-gateways
31562025-03-22T05:09:42.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36150
31572025-03-22T05:09:42.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36150 req_id = af55a1a7-2cc1-47bc-a52d-66d0846fa92f response_code = 200 uri = /vpc-routes
31582025-03-22T05:09:42.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57264
31592025-03-22T05:09:42.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57264 req_id = cbab87f8-ca5c-499b-a981-75c07129288f response_code = 200 uri = /v2p
31602025-03-22T05:09:42.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51312 req_id = 6de863df-376b-4eb0-8686-65013ac78a25 response_code = 204 uri = /vpc-routes
31612025-03-22T05:09:42.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31622025-03-22T05:09:42.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36150 req_id = 5b027386-48c1-4776-90f5-986d848989fd response_code = 204 uri = /eip-gateways
31632025-03-22T05:09:42.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36150 req_id = 9b1128d8-b259-4181-8fc4-9e2c3039a0dc response_code = 204 uri = /vpc-routes
31642025-03-22T05:09:42.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43985
31652025-03-22T05:09:42.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31662025-03-22T05:09:42.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31672025-03-22T05:09:42.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43985 req_id = af83604d-d252-4173-87fb-48bb71914fb3 response_code = 204 uri = /switch-ports
31682025-03-22T05:09:42.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43070
31692025-03-22T05:09:42.233ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31702025-03-22T05:09:42.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31712025-03-22T05:09:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86700 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43070 req_id = 66ceebf4-ad95-4062-a87f-316d66372507 response_code = 204 uri = /switch-ports
31722025-03-22T05:09:42.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35576
31732025-03-22T05:09:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43985 req_id = 40d29a47-9053-423b-9e31-3b2faceebe4f response_code = 200 uri = /network-bootstore-config
31742025-03-22T05:09:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43070 req_id = 2ff873a7-02ed-47cc-9705-9d2ba04a691b response_code = 200 uri = /network-bootstore-config
31752025-03-22T05:09:42.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35576 req_id = 1377a7cd-d21d-49d1-a359-11ce10be6bff response_code = 200 uri = /v2p
31762025-03-22T05:09:53.307ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56164
31772025-03-22T05:09:53.307ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56164 req_id = 1cce5a82-5ce0-477e-b442-c63195a2f49d response_code = 200 uri = /baseboard
31782025-03-22T05:10:07.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58333
31792025-03-22T05:10:07.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58333 req_id = 11ecde6f-0764-4a33-beb7-25953a3d2306 response_code = 200 uri = /vpc-routes
31802025-03-22T05:10:07.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
31812025-03-22T05:10:07.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58333 req_id = 9de50462-9672-46ad-b402-7412b25a3f7b response_code = 204 uri = /eip-gateways
31822025-03-22T05:10:07.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64227
31832025-03-22T05:10:07.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64227 req_id = f0d79938-8eb6-49be-9723-2a15cb7c4e98 response_code = 200 uri = /v2p
31842025-03-22T05:10:07.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33347
31852025-03-22T05:10:07.499ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
31862025-03-22T05:10:07.499ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
31872025-03-22T05:10:07.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33347 req_id = 4c657d09-bce7-4da5-af34-f4f6e4780e0d response_code = 204 uri = /artifacts-config
31882025-03-22T05:10:07.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31892025-03-22T05:10:07.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33347 req_id = cfbffcac-0b3e-4063-a97d-b7a424bb2630 response_code = 200 uri = /artifacts
31902025-03-22T05:10:07.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58333 req_id = aeb504bd-ad0b-4aa7-8329-90f4e8a528c3 response_code = 204 uri = /vpc-routes
31912025-03-22T05:10:07.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55151
31922025-03-22T05:10:07.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31932025-03-22T05:10:07.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31942025-03-22T05:10:07.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55151 req_id = fd8e2906-cff0-4cd8-a060-befb228e3c17 response_code = 204 uri = /switch-ports
31952025-03-22T05:10:07.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52180
31962025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
31972025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31982025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31992025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32002025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
32012025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32022025-03-22T05:10:07.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32032025-03-22T05:10:07.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52180 req_id = 31d15076-ea19-4901-ba23-7e2016e10624 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32042025-03-22T05:10:07.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55151 req_id = d4757333-8891-4066-8a07-a6b368a5bcb7 response_code = 200 uri = /network-bootstore-config
32052025-03-22T05:10:09.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6955 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = f44b4954-e9cb-4a26-87bd-9907c2b66e14 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
32062025-03-22T05:10:12.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38915
32072025-03-22T05:10:12.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38915 req_id = 4c028d08-ed6c-4e91-97df-705ac5899daf response_code = 200 uri = /vpc-routes
32082025-03-22T05:10:12.152ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
32092025-03-22T05:10:12.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38915 req_id = 7e391f6b-35ff-4efc-a3ce-4919485768a7 response_code = 204 uri = /eip-gateways
32102025-03-22T05:10:12.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38915 req_id = a1526cfb-6605-4924-8177-f9294a8d4dd6 response_code = 204 uri = /vpc-routes
32112025-03-22T05:10:12.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62732
32122025-03-22T05:10:12.162ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
32132025-03-22T05:10:12.163ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
32142025-03-22T05:10:12.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62732 req_id = 7cd3e9e0-7f98-4b82-9dcc-e0174b40d520 response_code = 204 uri = /artifacts-config
32152025-03-22T05:10:12.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32162025-03-22T05:10:12.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62732 req_id = 2c4f5cf8-09f9-4b26-b7d7-a349be05ac57 response_code = 200 uri = /artifacts
32172025-03-22T05:10:12.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47234
32182025-03-22T05:10:12.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47234 req_id = bfaee220-9c88-4618-acea-3d3aed9758d7 response_code = 200 uri = /v2p
32192025-03-22T05:10:12.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53481
32202025-03-22T05:10:12.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32212025-03-22T05:10:12.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32222025-03-22T05:10:12.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53481 req_id = 7ba34781-cfe2-4406-a89d-f22b0a8f03d1 response_code = 204 uri = /switch-ports
32232025-03-22T05:10:12.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36983
32242025-03-22T05:10:12.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36983 req_id = b25edd62-6e48-4dee-a36e-7356fa18ab03 response_code = 200 uri = /vpc-routes
32252025-03-22T05:10:12.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53481 req_id = ce662a62-ea12-45be-aa5b-9c5758fc10c8 response_code = 200 uri = /network-bootstore-config
32262025-03-22T05:10:12.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34593
32272025-03-22T05:10:12.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34593 req_id = 55a7c6ff-8e9a-44e4-bd11-5a9ea124c105 response_code = 200 uri = /v2p
32282025-03-22T05:10:12.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43624
32292025-03-22T05:10:12.445ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
32302025-03-22T05:10:12.445ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
32312025-03-22T05:10:12.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43624 req_id = 5a29033b-6a6a-4393-b708-84cc2aaa3f36 response_code = 204 uri = /artifacts-config
32322025-03-22T05:10:12.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32332025-03-22T05:10:12.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43624 req_id = 42ce74d3-8c5e-4cc4-86e8-8eb501e00f9f response_code = 200 uri = /artifacts
32342025-03-22T05:10:12.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
32352025-03-22T05:10:12.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36983 req_id = a975ec76-5da3-4a81-a781-b250c8ade9ad response_code = 204 uri = /eip-gateways
32362025-03-22T05:10:12.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36983 req_id = 01ec172e-5f47-4581-8618-ccb21688bdd9 response_code = 204 uri = /vpc-routes
32372025-03-22T05:10:12.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39021
32382025-03-22T05:10:12.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32392025-03-22T05:10:12.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32402025-03-22T05:10:12.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39021 req_id = f0b1e152-0f66-4c34-9b7f-2f9d173c595c response_code = 204 uri = /switch-ports
32412025-03-22T05:10:12.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33250
32422025-03-22T05:10:12.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39021 req_id = f3186ad6-fe06-414d-b5fa-b485f243a76a response_code = 200 uri = /network-bootstore-config
32432025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
32442025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32452025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32462025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32472025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
32482025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32492025-03-22T05:10:12.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32502025-03-22T05:10:12.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33250 req_id = 20beb648-3cdc-4ec7-bc8f-808973586e6c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32512025-03-22T05:10:12.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37481
32522025-03-22T05:10:12.656ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
32532025-03-22T05:10:12.656ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32542025-03-22T05:10:12.656ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32552025-03-22T05:10:12.656ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32562025-03-22T05:10:12.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
32572025-03-22T05:10:12.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32582025-03-22T05:10:12.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32592025-03-22T05:10:12.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37481 req_id = f951f9b1-1876-4a25-a37f-108d037b08c8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32602025-03-22T05:10:16.722ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
32612025-03-22T05:10:16.722ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
32622025-03-22T05:10:16.722ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
32632025-03-22T05:10:16.722ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
32642025-03-22T05:10:17.809ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:212
32652025-03-22T05:10:17.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32662025-03-22T05:10:17.840ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 2014, tv_nsec: 634588446 } time_to_next_cleanup = 599.99999619s
32672025-03-22T05:10:23.340ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46729
32682025-03-22T05:10:23.340ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46729 req_id = 46ffc079-a791-42ef-ade4-effd3e91d974 response_code = 200 uri = /baseboard
32692025-03-22T05:10:37.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57797
32702025-03-22T05:10:37.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57797 req_id = ba84ba04-d42a-4144-a059-c1f8864e3ef7 response_code = 200 uri = /vpc-routes
32712025-03-22T05:10:37.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
32722025-03-22T05:10:37.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57797 req_id = 59133a36-c414-415d-a68e-ea489cca150b response_code = 204 uri = /eip-gateways
32732025-03-22T05:10:37.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57797 req_id = 309a5c30-9043-4755-b34c-84dfad457c1d response_code = 204 uri = /vpc-routes
32742025-03-22T05:10:37.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38485
32752025-03-22T05:10:37.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32762025-03-22T05:10:37.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32772025-03-22T05:10:37.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38485 req_id = 38f0d380-50a9-4e21-a75a-7e603f34f7f0 response_code = 204 uri = /switch-ports
32782025-03-22T05:10:37.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32794
32792025-03-22T05:10:37.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38485 req_id = fff56e0e-e494-4299-b9be-60a73a1edb05 response_code = 200 uri = /network-bootstore-config
32802025-03-22T05:10:37.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32794 req_id = a00302fa-9339-4cec-a7ac-c079045040a6 response_code = 200 uri = /v2p
32812025-03-22T05:10:39.774ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8216 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 3716ea51-c7dd-463b-98d1-a9159e9d79b3 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
32822025-03-22T05:10:41.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45819
32832025-03-22T05:10:41.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45819 req_id = c478e2f3-26c6-4826-abb4-ef4db74ff6fb response_code = 200 uri = /vpc-routes
32842025-03-22T05:10:42.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
32852025-03-22T05:10:42.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45819 req_id = 284d0322-74fa-467d-a3d8-da99a5ea34b4 response_code = 204 uri = /eip-gateways
32862025-03-22T05:10:42.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45819 req_id = fae2a187-e72c-4dc5-9192-98a3e8688696 response_code = 204 uri = /vpc-routes
32872025-03-22T05:10:42.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64369
32882025-03-22T05:10:42.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32892025-03-22T05:10:42.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32902025-03-22T05:10:42.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64369 req_id = 8a50a2b8-bdcd-44dc-8bbf-535832d41476 response_code = 204 uri = /switch-ports
32912025-03-22T05:10:42.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43203
32922025-03-22T05:10:42.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43203 req_id = b644f4ba-578e-4287-9b25-d0ca265fd695 response_code = 200 uri = /vpc-routes
32932025-03-22T05:10:42.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64369 req_id = 7cbbe74a-39d0-4b8a-8bf6-34b4153af8c3 response_code = 200 uri = /network-bootstore-config
32942025-03-22T05:10:42.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56251
32952025-03-22T05:10:42.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56251 req_id = ae702fa9-a0ac-4763-9658-1d74c0bcb874 response_code = 200 uri = /v2p
32962025-03-22T05:10:42.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
32972025-03-22T05:10:42.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43203 req_id = 62b76316-d326-4d54-b9e3-010ecf87b283 response_code = 204 uri = /eip-gateways
32982025-03-22T05:10:42.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43203 req_id = 8743399b-fcc8-4158-8661-a7208c5ed96c response_code = 204 uri = /vpc-routes
32992025-03-22T05:10:42.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34945
33002025-03-22T05:10:42.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34945 req_id = 1f755223-86da-4e13-b61b-44f7100912f4 response_code = 200 uri = /v2p
33012025-03-22T05:10:42.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49973
33022025-03-22T05:10:42.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33032025-03-22T05:10:42.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33042025-03-22T05:10:42.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49973 req_id = 60a6570b-3769-4666-a1ae-77c39115ca93 response_code = 204 uri = /switch-ports
33052025-03-22T05:10:42.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49973 req_id = 8375f48c-b8a7-4400-b938-7aaba924d4d5 response_code = 200 uri = /network-bootstore-config
33062025-03-22T05:10:53.374ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63170
33072025-03-22T05:10:53.374ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63170 req_id = 866200d0-e79e-4580-87a6-8902f1813194 response_code = 200 uri = /baseboard
33082025-03-22T05:11:07.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36110
33092025-03-22T05:11:07.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36110 req_id = 67b3d3df-92dc-45fc-bf70-24b68e4c5811 response_code = 200 uri = /vpc-routes
33102025-03-22T05:11:07.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33112025-03-22T05:11:07.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36110 req_id = 8e3557fa-e5bb-47bb-8984-2ec7ed2d4914 response_code = 204 uri = /eip-gateways
33122025-03-22T05:11:07.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36110 req_id = e93f904d-f3fa-4d04-9a04-6d626add513d response_code = 204 uri = /vpc-routes
33132025-03-22T05:11:07.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42316
33142025-03-22T05:11:07.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42316 req_id = 4ea189c3-4978-41c6-adc5-e16eaf932f20 response_code = 200 uri = /v2p
33152025-03-22T05:11:07.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62577
33162025-03-22T05:11:07.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33172025-03-22T05:11:07.364ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33182025-03-22T05:11:07.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62577 req_id = 755185e5-d810-4b29-a18e-b01fd0ef73fa response_code = 204 uri = /switch-ports
33192025-03-22T05:11:07.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62577 req_id = 6ca1df82-00c6-45fb-9a23-7e3d3ff973f8 response_code = 200 uri = /network-bootstore-config
33202025-03-22T05:11:09.774ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7640 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = bda196ca-2949-4bd1-8bd6-a73c1e9cc6e8 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
33212025-03-22T05:11:12.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64417
33222025-03-22T05:11:12.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64417 req_id = f9f4990c-54d8-4914-9299-75ab3fbe2495 response_code = 200 uri = /vpc-routes
33232025-03-22T05:11:12.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33242025-03-22T05:11:12.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64417 req_id = fdf9b4ab-4642-4b01-b303-f1aec2d209a5 response_code = 204 uri = /eip-gateways
33252025-03-22T05:11:12.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64417 req_id = 21bfc68a-1d08-4d4c-99f6-9038e6dd4048 response_code = 204 uri = /vpc-routes
33262025-03-22T05:11:12.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37220
33272025-03-22T05:11:12.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37220 req_id = ff2ae012-4c56-42f0-877f-36bddfee949c response_code = 200 uri = /v2p
33282025-03-22T05:11:12.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55944
33292025-03-22T05:11:12.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33302025-03-22T05:11:12.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33312025-03-22T05:11:12.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55944 req_id = 86634def-b820-4021-a9fb-f7ae47408b76 response_code = 204 uri = /switch-ports
33322025-03-22T05:11:12.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47204
33332025-03-22T05:11:12.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47204 req_id = 51931656-0a8c-4562-8776-fad0cefa376d response_code = 200 uri = /vpc-routes
33342025-03-22T05:11:12.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55944 req_id = d7ca89b1-7e80-4b8a-8e15-16d60954c4d5 response_code = 200 uri = /network-bootstore-config
33352025-03-22T05:11:12.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33362025-03-22T05:11:12.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47204 req_id = 1c40305d-7838-438a-a5f2-510afb89efff response_code = 204 uri = /eip-gateways
33372025-03-22T05:11:12.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35833
33382025-03-22T05:11:12.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35833 req_id = a3aa1564-2e06-4262-9e55-2912312e0586 response_code = 200 uri = /v2p
33392025-03-22T05:11:12.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47204 req_id = fd4a038e-53b0-4a87-acce-98d090dd7213 response_code = 204 uri = /vpc-routes
33402025-03-22T05:11:12.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49961
33412025-03-22T05:11:12.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33422025-03-22T05:11:12.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33432025-03-22T05:11:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49961 req_id = cdd3370a-db20-40b2-a878-2f890ffaec9c response_code = 204 uri = /switch-ports
33442025-03-22T05:11:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49961 req_id = 00471132-dcfa-4e86-8a32-e1c6aecc89f7 response_code = 200 uri = /network-bootstore-config
33452025-03-22T05:11:16.722ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
33462025-03-22T05:11:16.722ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
33472025-03-22T05:11:16.722ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
33482025-03-22T05:11:16.722ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
33492025-03-22T05:11:23.408ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53308
33502025-03-22T05:11:23.408ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53308 req_id = 0fe6abbc-c1c4-4365-8cd0-437ce3c67fde response_code = 200 uri = /baseboard
33512025-03-22T05:11:37.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58983
33522025-03-22T05:11:37.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58983 req_id = 3d0bf6fb-fd42-4767-b6e3-646eaefcbf98 response_code = 200 uri = /vpc-routes
33532025-03-22T05:11:37.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33542025-03-22T05:11:37.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58983 req_id = aa60049c-581f-4811-9c35-a80b60342777 response_code = 204 uri = /eip-gateways
33552025-03-22T05:11:37.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58983 req_id = 9bb6f031-94b4-4a70-9d9b-10405ac29173 response_code = 204 uri = /vpc-routes
33562025-03-22T05:11:37.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44399
33572025-03-22T05:11:37.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44399 req_id = bbe38656-2eb8-4cb5-9135-8c08890ab8b8 response_code = 200 uri = /v2p
33582025-03-22T05:11:37.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34155
33592025-03-22T05:11:37.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33602025-03-22T05:11:37.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33612025-03-22T05:11:37.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34155 req_id = 4f135d07-53ef-4091-ab1a-5e9306f15a46 response_code = 204 uri = /switch-ports
33622025-03-22T05:11:37.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34155 req_id = 7779bcd3-8b52-4731-8e66-ad46799f4d40 response_code = 200 uri = /network-bootstore-config
33632025-03-22T05:11:39.773ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6764 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 1c137cb5-ee2e-45ed-94be-6704b897e7fc response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
33642025-03-22T05:11:41.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44186
33652025-03-22T05:11:41.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44186 req_id = 89420a13-c8c5-4fdf-9a8e-dd99a1e1b70f response_code = 200 uri = /vpc-routes
33662025-03-22T05:11:41.905ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33672025-03-22T05:11:41.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44186 req_id = b3befcc8-c57b-4e67-b9cd-0f19cce39b18 response_code = 204 uri = /eip-gateways
33682025-03-22T05:11:41.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44186 req_id = 45160e08-83be-4bca-b873-4ed86528f31d response_code = 204 uri = /vpc-routes
33692025-03-22T05:11:41.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54620
33702025-03-22T05:11:41.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54620 req_id = 4dc0b296-dce1-4975-92a6-b36e4fbf58e9 response_code = 200 uri = /vpc-routes
33712025-03-22T05:11:42.048ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33722025-03-22T05:11:42.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54620 req_id = a1a79293-574b-497c-8f43-cb78acb86503 response_code = 204 uri = /eip-gateways
33732025-03-22T05:11:42.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61413
33742025-03-22T05:11:42.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61413 req_id = dd2816e4-b6bb-4401-a8f7-2b88514ee70e response_code = 200 uri = /v2p
33752025-03-22T05:11:42.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59256
33762025-03-22T05:11:42.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33772025-03-22T05:11:42.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33782025-03-22T05:11:42.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97860 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59256 req_id = b1edc889-c817-4833-bbdc-f838e3569e59 response_code = 204 uri = /switch-ports
33792025-03-22T05:11:42.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58350
33802025-03-22T05:11:42.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59256 req_id = 30f92a19-f849-4a0f-86df-52ced393e356 response_code = 200 uri = /network-bootstore-config
33812025-03-22T05:11:42.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58350 req_id = 26266e0a-d420-4da0-baac-37692b073873 response_code = 200 uri = /v2p
33822025-03-22T05:11:42.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54620 req_id = 4d15c71e-1dfe-49b8-bb12-22c780554c55 response_code = 204 uri = /vpc-routes
33832025-03-22T05:11:42.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63932
33842025-03-22T05:11:42.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33852025-03-22T05:11:42.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33862025-03-22T05:11:42.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63932 req_id = 2331ed2a-bde8-42f0-8a71-e0457e693ff3 response_code = 204 uri = /switch-ports
33872025-03-22T05:11:42.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63932 req_id = bcdf6a5b-8271-44e8-b44d-6f004b34bbe1 response_code = 200 uri = /network-bootstore-config
33882025-03-22T05:11:53.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42030
33892025-03-22T05:11:53.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42030 req_id = 90951852-8f8c-4d3f-b721-e7da2e6d562a response_code = 200 uri = /baseboard
33902025-03-22T05:12:07.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44585
33912025-03-22T05:12:07.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44585 req_id = 3ef8ecf7-da4b-4f30-854b-e6fae3989e8b response_code = 200 uri = /vpc-routes
33922025-03-22T05:12:07.293ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
33932025-03-22T05:12:07.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44585 req_id = c27d75f4-a260-4110-8982-0ff6f164cee4 response_code = 204 uri = /eip-gateways
33942025-03-22T05:12:07.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64471
33952025-03-22T05:12:07.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64471 req_id = 34433123-d9e2-4fae-a410-b605e150aede response_code = 200 uri = /v2p
33962025-03-22T05:12:07.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44585 req_id = baa3840c-2378-4ea7-8d6b-ab04b5a1eefe response_code = 204 uri = /vpc-routes
33972025-03-22T05:12:07.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47690
33982025-03-22T05:12:07.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33992025-03-22T05:12:07.359ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34002025-03-22T05:12:07.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94513 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47690 req_id = 02e824bf-a46c-44ef-8685-aba8ab47f5bd response_code = 204 uri = /switch-ports
34012025-03-22T05:12:07.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47690 req_id = 8fcaecea-ff33-4615-a82f-79a4da4b7963 response_code = 200 uri = /network-bootstore-config
34022025-03-22T05:12:09.774ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7016 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = a6f72dd1-1a11-4b34-ac4e-76b8ecda3219 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
34032025-03-22T05:12:12.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39185
34042025-03-22T05:12:12.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39185 req_id = bc3b2e59-6aa3-4cfb-9bb6-36ad3473a217 response_code = 200 uri = /vpc-routes
34052025-03-22T05:12:12.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34062025-03-22T05:12:12.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39185 req_id = 65633ab7-7327-4529-b44c-ad181a37b16f response_code = 204 uri = /eip-gateways
34072025-03-22T05:12:12.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39185 req_id = 78a6a7ec-7a16-406d-b38f-96b63ce933d8 response_code = 204 uri = /vpc-routes
34082025-03-22T05:12:12.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38047
34092025-03-22T05:12:12.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38047 req_id = 102d64fb-b282-4042-852d-6ca1f4aaae5d response_code = 200 uri = /vpc-routes
34102025-03-22T05:12:12.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34112025-03-22T05:12:12.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38047 req_id = 7b0b6ab0-1377-478b-ab87-d412e91d7307 response_code = 204 uri = /eip-gateways
34122025-03-22T05:12:12.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52790
34132025-03-22T05:12:12.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52790 req_id = 3e5754cc-d7f2-4d09-b4e1-ed633ecbc602 response_code = 200 uri = /v2p
34142025-03-22T05:12:12.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38047 req_id = 6fa590b7-19f4-48a5-9635-c2bbcd0db1c9 response_code = 204 uri = /vpc-routes
34152025-03-22T05:12:12.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55239
34162025-03-22T05:12:12.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55239 req_id = 1dc07ef7-5d81-4f2c-adc1-c01ad2a5871d response_code = 200 uri = /v2p
34172025-03-22T05:12:12.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57386
34182025-03-22T05:12:12.415ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34192025-03-22T05:12:12.452ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34202025-03-22T05:12:12.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57386 req_id = 2d3ed6d6-4434-432d-97ea-38e1fc85d821 response_code = 204 uri = /switch-ports
34212025-03-22T05:12:12.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57386 req_id = ac417841-6ef9-456f-b9f7-356c3a544fcb response_code = 200 uri = /network-bootstore-config
34222025-03-22T05:12:12.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57942
34232025-03-22T05:12:12.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34242025-03-22T05:12:12.648ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34252025-03-22T05:12:12.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57942 req_id = e47af9a8-f4fb-437b-a461-53d438abbe18 response_code = 204 uri = /switch-ports
34262025-03-22T05:12:12.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57942 req_id = 27174a8d-6dfe-490a-8cda-c4ca3e023cf3 response_code = 200 uri = /network-bootstore-config
34272025-03-22T05:12:16.722ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
34282025-03-22T05:12:16.722ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
34292025-03-22T05:12:16.722ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
34302025-03-22T05:12:16.722ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
34312025-03-22T05:12:23.474ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62704
34322025-03-22T05:12:23.474ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62704 req_id = 2c6ec7ba-25de-4097-adf3-c3ab48834a74 response_code = 200 uri = /baseboard
34332025-03-22T05:12:37.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51863
34342025-03-22T05:12:37.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51863 req_id = abc4cbaa-00bb-44d6-942d-f999a0e80d06 response_code = 200 uri = /vpc-routes
34352025-03-22T05:12:37.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34362025-03-22T05:12:37.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51863 req_id = db6955c7-4ab6-4d81-a777-724c271b209b response_code = 204 uri = /eip-gateways
34372025-03-22T05:12:37.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51863 req_id = d08cacf1-fca9-4510-9c19-25db4897819c response_code = 204 uri = /vpc-routes
34382025-03-22T05:12:37.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58144
34392025-03-22T05:12:37.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58144 req_id = 73fab262-9cd2-4cac-971f-880681390538 response_code = 200 uri = /v2p
34402025-03-22T05:12:37.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38333
34412025-03-22T05:12:37.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34422025-03-22T05:12:37.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34432025-03-22T05:12:37.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38333 req_id = b3e5113b-bf97-44e9-b2b8-b4428e22436c response_code = 204 uri = /switch-ports
34442025-03-22T05:12:37.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38333 req_id = 148f65f3-e34f-4d60-a6fc-239deb69ecb7 response_code = 200 uri = /network-bootstore-config
34452025-03-22T05:12:39.774ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6542 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 73e270cb-8a16-44f8-9927-0588e0603f52 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
34462025-03-22T05:12:41.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42219
34472025-03-22T05:12:41.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42219 req_id = 1499a35d-e525-4288-a175-acb25f7c6d10 response_code = 200 uri = /v2p
34482025-03-22T05:12:41.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61740
34492025-03-22T05:12:41.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61740 req_id = b4a19b3d-d6e2-4b52-a5e2-18dcaa6b6eea response_code = 200 uri = /vpc-routes
34502025-03-22T05:12:42.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34512025-03-22T05:12:42.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61740 req_id = 19a2e6bc-a5ab-4142-a057-21044fcef48f response_code = 204 uri = /eip-gateways
34522025-03-22T05:12:42.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61740 req_id = e8175d24-cb42-4b92-ba27-605f3c6243b7 response_code = 204 uri = /vpc-routes
34532025-03-22T05:12:42.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44401
34542025-03-22T05:12:42.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44401 req_id = 2e5e1dbf-be67-4652-aa1a-11b78491b08b response_code = 200 uri = /vpc-routes
34552025-03-22T05:12:42.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34562025-03-22T05:12:42.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44401 req_id = 1ee6e48a-9d9d-4a64-8dab-bc2ca06d4b6f response_code = 204 uri = /eip-gateways
34572025-03-22T05:12:42.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39783
34582025-03-22T05:12:42.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34592025-03-22T05:12:42.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34602025-03-22T05:12:42.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39783 req_id = ef4ce5b6-a45f-4267-b8ee-6c131ccc6852 response_code = 204 uri = /switch-ports
34612025-03-22T05:12:42.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36151
34622025-03-22T05:12:42.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65149
34632025-03-22T05:12:42.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36151 req_id = 15aa14de-a425-458a-a0af-aaf28228e135 response_code = 200 uri = /v2p
34642025-03-22T05:12:42.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34652025-03-22T05:12:42.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39783 req_id = c7bf001b-caef-4d7a-b4ac-b9314b074260 response_code = 200 uri = /network-bootstore-config
34662025-03-22T05:12:42.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44401 req_id = 4fdb4ff8-ece5-425e-87ee-b0a07888a42b response_code = 204 uri = /vpc-routes
34672025-03-22T05:12:42.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34682025-03-22T05:12:42.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65149 req_id = 511d2497-8044-4a3a-8607-2d9f40c27e3d response_code = 204 uri = /switch-ports
34692025-03-22T05:12:42.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65149 req_id = aad190aa-aad6-4117-b346-1da8cf8395f0 response_code = 200 uri = /network-bootstore-config
34702025-03-22T05:12:53.522ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57550
34712025-03-22T05:12:53.522ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57550 req_id = 92a59607-9006-4327-8d75-00ef86dedeac response_code = 200 uri = /baseboard
34722025-03-22T05:13:07.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36253
34732025-03-22T05:13:07.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36253 req_id = 987b934d-4773-4bb1-a363-dcc9428444ec response_code = 200 uri = /vpc-routes
34742025-03-22T05:13:07.338ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34752025-03-22T05:13:07.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36253 req_id = d56bf69a-7db2-419e-ba0c-0515742729be response_code = 204 uri = /eip-gateways
34762025-03-22T05:13:07.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36253 req_id = 273000f5-fe57-4b09-b63c-5262d5178364 response_code = 204 uri = /vpc-routes
34772025-03-22T05:13:07.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41749
34782025-03-22T05:13:07.421ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34792025-03-22T05:13:07.462ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34802025-03-22T05:13:07.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41749 req_id = 1cfbb165-5553-4ebb-a32e-04b94352f129 response_code = 204 uri = /switch-ports
34812025-03-22T05:13:07.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62026
34822025-03-22T05:13:07.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41749 req_id = b20ed420-2672-48a2-a740-3b658405946c response_code = 200 uri = /network-bootstore-config
34832025-03-22T05:13:07.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62026 req_id = c0c5e572-f9a0-4972-a15e-319c5eb05f3a response_code = 200 uri = /v2p
34842025-03-22T05:13:09.776ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7815 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 7f94c657-1c44-4c1a-a386-62b94945e570 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
34852025-03-22T05:13:12.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53978
34862025-03-22T05:13:12.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53978 req_id = 4e52e301-2bb7-40e1-875e-4dd36fec7b91 response_code = 200 uri = /vpc-routes
34872025-03-22T05:13:12.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34882025-03-22T05:13:12.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53978 req_id = f086951f-7129-4891-a350-aa4ccb4a3f77 response_code = 204 uri = /eip-gateways
34892025-03-22T05:13:12.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53978 req_id = 5e8c6fac-cf64-4aff-ba1e-82608f688601 response_code = 204 uri = /vpc-routes
34902025-03-22T05:13:12.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54337
34912025-03-22T05:13:12.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54337 req_id = 59be39ab-be12-4033-aca9-5ca7cceecd29 response_code = 200 uri = /vpc-routes
34922025-03-22T05:13:12.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
34932025-03-22T05:13:12.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54337 req_id = e12c8cd8-e656-4b5f-a515-56470979e844 response_code = 204 uri = /eip-gateways
34942025-03-22T05:13:12.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54337 req_id = d76aed4d-2761-41fc-ac30-c5463a76053d response_code = 204 uri = /vpc-routes
34952025-03-22T05:13:12.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51120
34962025-03-22T05:13:12.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51120 req_id = cd84d2ce-e710-4aed-a0b2-20fa923427b5 response_code = 200 uri = /v2p
34972025-03-22T05:13:12.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36808
34982025-03-22T05:13:12.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34992025-03-22T05:13:12.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35002025-03-22T05:13:12.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36808 req_id = 7f0ae2c9-9ee6-42f1-b0a0-e92de3381358 response_code = 204 uri = /switch-ports
35012025-03-22T05:13:12.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36808 req_id = 8bc562d4-8a56-4886-a70a-1eb9f62db067 response_code = 200 uri = /network-bootstore-config
35022025-03-22T05:13:12.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38730
35032025-03-22T05:13:12.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38730 req_id = b74f751a-caec-41cd-8b3e-b81b0a6c9d2f response_code = 200 uri = /v2p
35042025-03-22T05:13:12.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37594
35052025-03-22T05:13:12.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35062025-03-22T05:13:12.547ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35072025-03-22T05:13:12.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37594 req_id = 55ec2b4c-da52-4bb5-879f-bcad5366134a response_code = 204 uri = /switch-ports
35082025-03-22T05:13:12.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37594 req_id = 53e4c2d6-4b30-4988-9c22-5c1b9edfa741 response_code = 200 uri = /network-bootstore-config
35092025-03-22T05:13:16.723ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
35102025-03-22T05:13:16.723ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
35112025-03-22T05:13:16.723ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
35122025-03-22T05:13:16.723ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
35132025-03-22T05:13:23.554ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50651
35142025-03-22T05:13:23.554ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50651 req_id = 95738277-db6b-4fbc-9a99-bbeb11cef73a response_code = 200 uri = /baseboard
35152025-03-22T05:13:37.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49258
35162025-03-22T05:13:37.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49258 req_id = b3b47e91-7ca6-4e3b-8874-0bfd27745059 response_code = 200 uri = /vpc-routes
35172025-03-22T05:13:37.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35182025-03-22T05:13:37.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49258 req_id = a31eb613-c892-405f-ac7f-ea62b7ab84e5 response_code = 204 uri = /eip-gateways
35192025-03-22T05:13:37.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49258 req_id = cc58eed8-b652-421d-a2ff-ddeb9d73bc42 response_code = 204 uri = /vpc-routes
35202025-03-22T05:13:37.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48146
35212025-03-22T05:13:37.115ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35222025-03-22T05:13:37.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35232025-03-22T05:13:37.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48146 req_id = 62e520cb-ea78-47f3-b1e0-abe6469c2917 response_code = 204 uri = /switch-ports
35242025-03-22T05:13:37.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54315
35252025-03-22T05:13:37.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54315 req_id = 3c3825dc-5d18-47b6-a591-d09a83e96c5f response_code = 200 uri = /v2p
35262025-03-22T05:13:37.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48146 req_id = 7283334b-bf8d-4833-8edc-c3258776ca42 response_code = 200 uri = /network-bootstore-config
35272025-03-22T05:13:39.777ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 48d0a32c-4d39-4d3a-9169-05006193bb74 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
35282025-03-22T05:13:41.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39248
35292025-03-22T05:13:41.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39248 req_id = 8342392b-8ac1-4c66-89e2-38ef61c32a49 response_code = 200 uri = /vpc-routes
35302025-03-22T05:13:41.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45613
35312025-03-22T05:13:41.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45613 req_id = 9a763b89-afe7-4df4-a384-c298dc896221 response_code = 200 uri = /v2p
35322025-03-22T05:13:41.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35332025-03-22T05:13:41.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39248 req_id = 7a3dfeb5-06fc-42ec-bd5d-bef40865e251 response_code = 204 uri = /eip-gateways
35342025-03-22T05:13:41.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39248 req_id = 64c05c67-e9cd-429a-91e5-5d08be881867 response_code = 204 uri = /vpc-routes
35352025-03-22T05:13:42.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43754
35362025-03-22T05:13:42.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35372025-03-22T05:13:42.060ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35382025-03-22T05:13:42.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43754 req_id = c99b7099-7930-4a0c-b17d-74375db0153c response_code = 204 uri = /switch-ports
35392025-03-22T05:13:42.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53873
35402025-03-22T05:13:42.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53873 req_id = 740b0bc9-ccb2-4545-b6ec-424b59c1975e response_code = 200 uri = /vpc-routes
35412025-03-22T05:13:42.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43754 req_id = 098c74b2-9d8f-48a4-8b33-b1ccbd777cbe response_code = 200 uri = /network-bootstore-config
35422025-03-22T05:13:42.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35432025-03-22T05:13:42.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53873 req_id = d725d441-31c1-482f-a82c-933b886e4ffd response_code = 204 uri = /eip-gateways
35442025-03-22T05:13:42.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64377
35452025-03-22T05:13:42.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64377 req_id = cab0c9da-2547-4dc6-b727-b2d50ed4d82c response_code = 200 uri = /v2p
35462025-03-22T05:13:42.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53873 req_id = cb3c077c-eeeb-417c-b657-6d54898926c6 response_code = 204 uri = /vpc-routes
35472025-03-22T05:13:42.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42713
35482025-03-22T05:13:42.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35492025-03-22T05:13:42.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35502025-03-22T05:13:42.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42713 req_id = 295d3aef-1fa3-4f5e-b92e-ea4df2298c95 response_code = 204 uri = /switch-ports
35512025-03-22T05:13:42.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42713 req_id = c2eed678-c7e5-4679-ba74-f2088714b9b2 response_code = 200 uri = /network-bootstore-config
35522025-03-22T05:13:53.586ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44989
35532025-03-22T05:13:53.586ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44989 req_id = ef6119df-1521-49ce-9402-e5df26d12390 response_code = 200 uri = /baseboard
35542025-03-22T05:14:07.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43209
35552025-03-22T05:14:07.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43209 req_id = 750d1390-4340-4a53-8d83-1e199a5f1084 response_code = 200 uri = /vpc-routes
35562025-03-22T05:14:07.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38965
35572025-03-22T05:14:07.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38965 req_id = 5105cfd2-f037-4077-b86b-8a8471c44ed8 response_code = 200 uri = /v2p
35582025-03-22T05:14:07.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35592025-03-22T05:14:07.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43209 req_id = 53517969-20b3-4568-a9bb-2eb1456d1dff response_code = 204 uri = /eip-gateways
35602025-03-22T05:14:07.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43209 req_id = 28cba2f9-d725-44a8-abb0-c1aa63188039 response_code = 204 uri = /vpc-routes
35612025-03-22T05:14:07.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61558
35622025-03-22T05:14:07.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35632025-03-22T05:14:07.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35642025-03-22T05:14:07.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61558 req_id = 7efeda08-5eb2-4dec-b5a9-c7cd6d13782e response_code = 204 uri = /switch-ports
35652025-03-22T05:14:07.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61558 req_id = fe71d97e-c21b-4d15-b260-8b6694fafe40 response_code = 200 uri = /network-bootstore-config
35662025-03-22T05:14:09.775ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6798 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 3a20394c-1efc-4de0-ab69-987d1d340443 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
35672025-03-22T05:14:12.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60696
35682025-03-22T05:14:12.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60696 req_id = f0a02699-7d96-47c9-8b73-71f48d147f5a response_code = 200 uri = /vpc-routes
35692025-03-22T05:14:12.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43598
35702025-03-22T05:14:12.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43598 req_id = 4bd33d12-784d-40d9-9382-863e20cbaa15 response_code = 200 uri = /v2p
35712025-03-22T05:14:12.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35722025-03-22T05:14:12.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60696 req_id = 3cf30ef1-8011-435e-8a4f-5f90dc55b907 response_code = 204 uri = /eip-gateways
35732025-03-22T05:14:12.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60696 req_id = 7cc019d8-b81e-4f02-8495-f3c8ee1dc63b response_code = 204 uri = /vpc-routes
35742025-03-22T05:14:12.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49777
35752025-03-22T05:14:12.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35762025-03-22T05:14:12.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35772025-03-22T05:14:12.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49777 req_id = 3114735e-46cd-4980-90cc-715e03dbd106 response_code = 204 uri = /switch-ports
35782025-03-22T05:14:12.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35514
35792025-03-22T05:14:12.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61478
35802025-03-22T05:14:12.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61478 req_id = c949f9ce-a6f1-488d-beef-fbc386fa42a2 response_code = 200 uri = /vpc-routes
35812025-03-22T05:14:12.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49777 req_id = f07353fc-73a1-482a-8f32-d5ad0416e792 response_code = 200 uri = /network-bootstore-config
35822025-03-22T05:14:12.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35514 req_id = 4808c409-a365-4495-8476-095c4a845216 response_code = 200 uri = /v2p
35832025-03-22T05:14:12.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45438
35842025-03-22T05:14:12.359ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35852025-03-22T05:14:12.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35862025-03-22T05:14:12.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45438 req_id = 23bd562a-4ea0-462b-8d4f-0b3e2b508f7a response_code = 204 uri = /switch-ports
35872025-03-22T05:14:12.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
35882025-03-22T05:14:12.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61478 req_id = 18a64792-a08a-4ad8-97b0-d40ebec2cfdc response_code = 204 uri = /eip-gateways
35892025-03-22T05:14:12.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45438 req_id = f21f1c22-d066-4cbd-a608-33ea444b9fc8 response_code = 200 uri = /network-bootstore-config
35902025-03-22T05:14:12.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61478 req_id = fc463ff6-c78b-4505-b039-c64b3f137d5d response_code = 204 uri = /vpc-routes
35912025-03-22T05:14:16.724ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
35922025-03-22T05:14:16.725ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
35932025-03-22T05:14:16.725ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
35942025-03-22T05:14:16.725ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
35952025-03-22T05:14:22.877ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
35962025-03-22T05:14:23.619ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42163
35972025-03-22T05:14:23.619ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42163 req_id = 0384733d-40e8-4084-80e0-33804ab8b6c7 response_code = 200 uri = /baseboard
35982025-03-22T05:14:37.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65097
35992025-03-22T05:14:37.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65097 req_id = aaa190c7-6442-4326-8c92-d55d13e48383 response_code = 200 uri = /vpc-routes
36002025-03-22T05:14:37.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
36012025-03-22T05:14:37.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65097 req_id = 7427e74f-933e-4df9-9a76-9eeae65d0d8d response_code = 204 uri = /eip-gateways
36022025-03-22T05:14:37.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65097 req_id = 18fa7c4b-bb52-4ad1-ba60-b3168ab1bae1 response_code = 204 uri = /vpc-routes
36032025-03-22T05:14:37.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48174
36042025-03-22T05:14:37.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36052025-03-22T05:14:37.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36062025-03-22T05:14:37.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48174 req_id = d991c2a0-e7e9-40e5-b515-6a92f3c0994b response_code = 204 uri = /switch-ports
36072025-03-22T05:14:37.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38848
36082025-03-22T05:14:37.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38848 req_id = 2b15d1df-08e2-44ab-b5ae-1546826934ca response_code = 200 uri = /v2p
36092025-03-22T05:14:37.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48174 req_id = 7f51dec4-f81b-41ac-8094-1f25f2be8a4d response_code = 200 uri = /network-bootstore-config
36102025-03-22T05:14:39.776ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6791 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 5351c694-c280-4a2e-a3a2-a3cf268bb68a response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
36112025-03-22T05:14:41.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47287
36122025-03-22T05:14:41.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47287 req_id = 31031a0c-98dc-4337-a7a9-17b2f5f14c65 response_code = 200 uri = /vpc-routes
36132025-03-22T05:14:41.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
36142025-03-22T05:14:41.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47287 req_id = e62695d3-6156-47ab-aaae-25b18c74c208 response_code = 204 uri = /eip-gateways
36152025-03-22T05:14:41.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47287 req_id = 47f83b9c-0dab-46e9-a64c-51b443363dd6 response_code = 204 uri = /vpc-routes
36162025-03-22T05:14:42.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46084
36172025-03-22T05:14:42.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46084 req_id = 244fa456-7876-45d1-9d44-e1d1f86aa965 response_code = 200 uri = /vpc-routes
36182025-03-22T05:14:42.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34351
36192025-03-22T05:14:42.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34351 req_id = 78d61338-d249-42fb-ac2c-b482b711d9e7 response_code = 200 uri = /v2p
36202025-03-22T05:14:42.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33788
36212025-03-22T05:14:42.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33788 req_id = 51ff1473-4086-49b7-ba18-16cd9699f5a0 response_code = 200 uri = /v2p
36222025-03-22T05:14:42.080ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
36232025-03-22T05:14:42.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46084 req_id = 2392ddbe-0d67-4697-82a0-0f0999a274f2 response_code = 204 uri = /eip-gateways
36242025-03-22T05:14:42.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53989
36252025-03-22T05:14:42.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36262025-03-22T05:14:42.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36272025-03-22T05:14:42.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53989 req_id = c25065ee-41b5-4eaa-86c7-1b532cca9db1 response_code = 204 uri = /switch-ports
36282025-03-22T05:14:42.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58727
36292025-03-22T05:14:42.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53989 req_id = e5b1d423-9a40-44af-ab18-a54c63348b9b response_code = 200 uri = /network-bootstore-config
36302025-03-22T05:14:42.183ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36312025-03-22T05:14:42.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46084 req_id = 9277aa84-7069-4c11-acc1-860c12dee270 response_code = 204 uri = /vpc-routes
36322025-03-22T05:14:42.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36332025-03-22T05:14:42.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58727 req_id = 2d2b67aa-004e-446b-a44d-29f39add4f8a response_code = 204 uri = /switch-ports
36342025-03-22T05:14:42.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58727 req_id = 74172d73-323d-41bf-b1a7-45ce77c4f5ce response_code = 200 uri = /network-bootstore-config
36352025-03-22T05:14:53.655ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38829
36362025-03-22T05:14:53.655ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38829 req_id = 4a545d32-132e-413c-a1ce-d543880ca46d response_code = 200 uri = /baseboard
36372025-03-22T05:15:07.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53008
36382025-03-22T05:15:07.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53008 req_id = da426e98-378b-4f12-b34e-3c08e7a39ca8 response_code = 200 uri = /vpc-routes
36392025-03-22T05:15:07.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56878
36402025-03-22T05:15:07.274ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
36412025-03-22T05:15:07.275ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
36422025-03-22T05:15:07.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56878 req_id = bbb3f476-c5ce-43f1-b4fb-7fa3956195b7 response_code = 204 uri = /artifacts-config
36432025-03-22T05:15:07.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36442025-03-22T05:15:07.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56878 req_id = db674c5d-4229-4685-9560-61e7297c8b8d response_code = 200 uri = /artifacts
36452025-03-22T05:15:07.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
36462025-03-22T05:15:07.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53008 req_id = c1b9819b-cb27-40d0-a5b7-9785de30d15b response_code = 204 uri = /eip-gateways
36472025-03-22T05:15:07.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53008 req_id = 244304a0-98f4-4b26-b4d3-c45bad4ca006 response_code = 204 uri = /vpc-routes
36482025-03-22T05:15:07.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40608
36492025-03-22T05:15:07.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36502025-03-22T05:15:07.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36512025-03-22T05:15:07.393ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
36522025-03-22T05:15:07.393ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
36532025-03-22T05:15:07.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54348
36542025-03-22T05:15:07.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36552025-03-22T05:15:07.413ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36562025-03-22T05:15:07.413ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
36572025-03-22T05:15:07.454ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36582025-03-22T05:15:07.454ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
36592025-03-22T05:15:07.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36602025-03-22T05:15:07.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57949
36612025-03-22T05:15:07.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57949 req_id = 54f14898-c0a6-42cc-9dc1-5cd0d8cbef03 response_code = 200 uri = /v2p
36622025-03-22T05:15:07.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36632025-03-22T05:15:07.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
36642025-03-22T05:15:07.530ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36652025-03-22T05:15:07.530ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
36662025-03-22T05:15:07.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54348 req_id = 0c77d998-84f0-42b3-b1e8-0049561f90f1 response_code = 204 uri = /switch-ports
36672025-03-22T05:15:07.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33315
36682025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
36692025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36702025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36712025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
36722025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
36732025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36742025-03-22T05:15:07.559ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
36752025-03-22T05:15:07.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 927 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33315 req_id = 291d7a09-ca44-4797-8c59-9bad62eb544d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
36762025-03-22T05:15:07.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54348 req_id = 9ebec1f7-879d-4a22-93b0-693b5acf5560 response_code = 200 uri = /network-bootstore-config
36772025-03-22T05:15:07.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36782025-03-22T05:15:07.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
36792025-03-22T05:15:07.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36802025-03-22T05:15:07.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
36812025-03-22T05:15:07.633ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36822025-03-22T05:15:07.634ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
36832025-03-22T05:15:07.662ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36842025-03-22T05:15:07.662ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
36852025-03-22T05:15:07.686ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36862025-03-22T05:15:07.686ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
36872025-03-22T05:15:07.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40608 req_id = 797acebf-31e7-4cb6-a7cb-66b95c1f5774 response_code = 200 uri = /inventory
36882025-03-22T05:15:09.778ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8561 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 815bbe52-8ec0-4339-992a-f82b7aedd620 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
36892025-03-22T05:15:12.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43691
36902025-03-22T05:15:12.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43691 req_id = 763606a4-d90f-4951-9b44-46bc58d7f68e response_code = 200 uri = /vpc-routes
36912025-03-22T05:15:12.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
36922025-03-22T05:15:12.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43691 req_id = 38c71c18-2cdd-4e0d-b4d2-cf288cc34e71 response_code = 204 uri = /eip-gateways
36932025-03-22T05:15:12.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43691 req_id = 8d83f9db-daaa-4ecf-9f90-6e44487ab71f response_code = 204 uri = /vpc-routes
36942025-03-22T05:15:12.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38569
36952025-03-22T05:15:12.271ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
36962025-03-22T05:15:12.272ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
36972025-03-22T05:15:12.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38569 req_id = 4eff7eb1-3eee-4848-8c1b-460a42ef783c response_code = 204 uri = /artifacts-config
36982025-03-22T05:15:12.272ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36992025-03-22T05:15:12.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38569 req_id = 278561a1-18f5-4c19-887a-67849d97a414 response_code = 200 uri = /artifacts
37002025-03-22T05:15:12.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33413
37012025-03-22T05:15:12.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
37022025-03-22T05:15:12.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
37032025-03-22T05:15:12.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33413 req_id = 01a95006-f1fb-4ea4-a5de-465106a145ba response_code = 204 uri = /switch-ports
37042025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36658
37052025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39092
37062025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65152
37072025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44388
37082025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33413 req_id = b14cd5e0-e42a-49f3-a0f9-35b03f26556d response_code = 200 uri = /network-bootstore-config
37092025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36658 req_id = 0dae8051-15c9-4d76-97b0-7dc6314cb7e0 response_code = 200 uri = /vpc-routes
37102025-03-22T05:15:12.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37112025-03-22T05:15:12.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37122025-03-22T05:15:12.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44388 req_id = a7905398-eb0d-43df-9f0a-adbb83e5f0d7 response_code = 200 uri = /v2p
37132025-03-22T05:15:12.480ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
37142025-03-22T05:15:12.480ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
37152025-03-22T05:15:12.481ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
37162025-03-22T05:15:12.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39092 req_id = 222218ae-13da-4342-929f-0545e86423dd response_code = 204 uri = /artifacts-config
37172025-03-22T05:15:12.481ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
37182025-03-22T05:15:12.481ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37192025-03-22T05:15:12.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39092 req_id = e0840ba6-85a8-4c9e-8731-05cf1f9ca32c response_code = 200 uri = /artifacts
37202025-03-22T05:15:12.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37212025-03-22T05:15:12.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
37222025-03-22T05:15:12.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52861
37232025-03-22T05:15:12.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37242025-03-22T05:15:12.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37252025-03-22T05:15:12.511ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/config/omicron-zones.json file = common/src/ledger.rs:175
37262025-03-22T05:15:12.516ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/config/omicron-zones.json file = common/src/ledger.rs:175
37272025-03-22T05:15:12.524ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37282025-03-22T05:15:12.524ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
37292025-03-22T05:15:12.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34427
37302025-03-22T05:15:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34427 req_id = 07f8a421-9958-49a2-bde2-59c28ceb6bbd response_code = 200 uri = /v2p
37312025-03-22T05:15:12.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62354
37322025-03-22T05:15:12.529ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
37332025-03-22T05:15:12.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f282df4c-a498-441e-a714-cfa606ade1c7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37342025-03-22T05:15:12.538ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f282df4c-a498-441e-a714-cfa606ade1c7
37352025-03-22T05:15:12.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b47c4962-4319-408d-9df5-7ff4139e32f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37362025-03-22T05:15:12.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_b47c4962-4319-408d-9df5-7ff4139e32f5
37372025-03-22T05:15:12.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
37382025-03-22T05:15:12.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36658 req_id = 942eb685-6719-4a38-8b3d-d88ac6cde9b7 response_code = 204 uri = /eip-gateways
37392025-03-22T05:15:12.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
37402025-03-22T05:15:12.582ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37412025-03-22T05:15:12.583ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
37422025-03-22T05:15:12.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 13465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36658 req_id = 8340f756-5c83-4b59-b909-b8e7adbbe3c0 response_code = 204 uri = /vpc-routes
37432025-03-22T05:15:12.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5436dcfe-a58e-4d96-a581-643f03565c69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37442025-03-22T05:15:12.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_5436dcfe-a58e-4d96-a581-643f03565c69
37452025-03-22T05:15:12.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37462025-03-22T05:15:12.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
37472025-03-22T05:15:12.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49284
37482025-03-22T05:15:12.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37492025-03-22T05:15:12.656ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
37502025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
37512025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37522025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37532025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37542025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
37552025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37562025-03-22T05:15:12.662ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37572025-03-22T05:15:12.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 975 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49284 req_id = a89f54ea-4595-4b24-aade-a030bba4f99e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37582025-03-22T05:15:12.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62354 req_id = c67ce486-c05f-4d7d-a358-e57e7688fe34 response_code = 204 uri = /switch-ports
37592025-03-22T05:15:12.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62354 req_id = 78fd8f3f-ffe8-4919-9b85-6b89692facdf response_code = 200 uri = /network-bootstore-config
37602025-03-22T05:15:12.670ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25a954fe-dd77-4935-9929-93fce92615d1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37612025-03-22T05:15:12.670ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_25a954fe-dd77-4935-9929-93fce92615d1
37622025-03-22T05:15:12.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52953
37632025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8785e7a8-de67-49d4-b831-0784495214bb, kind: Service { id: 522a574f-0efa-4922-b459-92f33337de0c }, name: Name("external-dns-522a574f-0efa-4922-b459-92f33337de0c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 137])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff53639c-43fc-4f0b-b8b8-e7a3459d665e, kind: Service { id: 066e897f-f97f-4c94-b64d-82bac3890965 }, name: Name("external-dns-066e897f-f97f-4c94-b64d-82bac3890965"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a66cca9-df39-4695-9b25-a3e79c0c27fb, kind: Service { id: 34c000f6-dc91-4da0-8401-c69f9ab4b07e }, name: Name("nexus-34c000f6-dc91-4da0-8401-c69f9ab4b07e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669d2ff0-c2c1-4855-aed0-c0bd557c3448, kind: Service { id: 4853a98e-3dee-4dfc-ae1a-a638b142b7ad }, name: Name("nexus-4853a98e-3dee-4dfc-ae1a-a638b142b7ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef8bf0e0-eed4-4e26-ae24-1fea9d5fbe19, kind: Service { id: ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90 }, name: Name("nexus-ac1cfeaf-8e99-4d58-a94b-c2058b5bfb90"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
37642025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37652025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37662025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37672025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
37682025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37692025-03-22T05:15:12.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37702025-03-22T05:15:12.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52953 req_id = 9744eaa1-09e9-4313-ba59-0e9fd124b54b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37712025-03-22T05:15:12.691ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37722025-03-22T05:15:12.691ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
37732025-03-22T05:15:12.706ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7461c1f9-7632-471b-95a6-fd6c9e85fd09 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37742025-03-22T05:15:12.706ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7461c1f9-7632-471b-95a6-fd6c9e85fd09
37752025-03-22T05:15:12.730ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ed71c1a-38c4-4e79-835c-4608b7e5b9a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37762025-03-22T05:15:12.730ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_1ed71c1a-38c4-4e79-835c-4608b7e5b9a2
37772025-03-22T05:15:12.744ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37782025-03-22T05:15:12.744ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
37792025-03-22T05:15:12.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7deb16a6-d604-4284-9783-3c07eddc30d2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37802025-03-22T05:15:12.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_7deb16a6-d604-4284-9783-3c07eddc30d2
37812025-03-22T05:15:12.773ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37822025-03-22T05:15:12.773ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
37832025-03-22T05:15:12.794ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37842025-03-22T05:15:12.794ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
37852025-03-22T05:15:12.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0218e542-b0d7-4d7c-8d83-2a3abd5381c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37862025-03-22T05:15:12.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_0218e542-b0d7-4d7c-8d83-2a3abd5381c4
37872025-03-22T05:15:12.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 331172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65152 req_id = c476f71d-7cf4-4388-ba9b-0154d83d9dbc response_code = 200 uri = /inventory
37882025-03-22T05:15:12.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2feb83c9-6c1b-479e-9359-21a5a50a2673 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37892025-03-22T05:15:12.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2feb83c9-6c1b-479e-9359-21a5a50a2673
37902025-03-22T05:15:12.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 346200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52861 req_id = 68f2eb91-468e-4808-8da9-07651b4f8b68 response_code = 200 uri = /inventory
37912025-03-22T05:15:16.725ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
37922025-03-22T05:15:16.725ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
37932025-03-22T05:15:16.725ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
37942025-03-22T05:15:16.725ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
37952025-03-22T05:15:23.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46661
37962025-03-22T05:15:23.688ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46661 req_id = 1a377e84-1de5-48d4-af66-9af32c031734 response_code = 200 uri = /baseboard
37972025-03-22T05:15:37.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52123
37982025-03-22T05:15:37.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52123 req_id = b7922c05-2949-4bb8-8a37-d0c5e6925926 response_code = 200 uri = /vpc-routes
37992025-03-22T05:15:37.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
38002025-03-22T05:15:37.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52123 req_id = 703c23f0-4fe3-4c97-ae09-9ea2374428cd response_code = 204 uri = /eip-gateways
38012025-03-22T05:15:37.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44478
38022025-03-22T05:15:37.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44478 req_id = bc2193a7-677e-4c58-9438-c6e98910b2c9 response_code = 200 uri = /v2p
38032025-03-22T05:15:37.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52123 req_id = 98e0116e-2b34-4b0a-8d1f-43486d6eb26c response_code = 204 uri = /vpc-routes
38042025-03-22T05:15:37.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36864
38052025-03-22T05:15:37.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38062025-03-22T05:15:37.318ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38072025-03-22T05:15:37.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36864 req_id = 0ca02b95-e4bd-44e1-a072-4792a90ad8a6 response_code = 204 uri = /switch-ports
38082025-03-22T05:15:37.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36864 req_id = ac1f9d91-01f7-481e-833e-23aa0ac538de response_code = 200 uri = /network-bootstore-config
38092025-03-22T05:15:39.777ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7607 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = 63da7ba9-0802-4808-80e4-83c8d429f761 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
38102025-03-22T05:15:41.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47632
38112025-03-22T05:15:41.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47632 req_id = 458432e1-2a08-4c8b-b16d-80e307b89d00 response_code = 200 uri = /vpc-routes
38122025-03-22T05:15:41.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45419
38132025-03-22T05:15:41.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45419 req_id = 9fc9bf01-3d05-4418-9fb3-079c2b44b8fa response_code = 200 uri = /vpc-routes
38142025-03-22T05:15:41.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
38152025-03-22T05:15:41.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47632 req_id = ecbb2c2e-063b-4baf-8dd0-74dba1340a83 response_code = 204 uri = /eip-gateways
38162025-03-22T05:15:41.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47632 req_id = 79be9e34-4083-4697-8965-1be6c75ce367 response_code = 204 uri = /vpc-routes
38172025-03-22T05:15:42.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
38182025-03-22T05:15:42.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45419 req_id = a5a996b2-e79a-40e3-9ca2-d2171e3522c9 response_code = 204 uri = /eip-gateways
38192025-03-22T05:15:42.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33939
38202025-03-22T05:15:42.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33939 req_id = 18aec083-899e-4cfc-a3c6-cf4b7822d7d5 response_code = 200 uri = /v2p
38212025-03-22T05:15:42.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50899
38222025-03-22T05:15:42.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38232025-03-22T05:15:42.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38242025-03-22T05:15:42.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50899 req_id = bcfec08c-f28f-426d-81e8-ff2f5fb75199 response_code = 204 uri = /switch-ports
38252025-03-22T05:15:42.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56602
38262025-03-22T05:15:42.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52144
38272025-03-22T05:15:42.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50899 req_id = 3945c4b5-d1ec-4055-8336-483234a3c92d response_code = 200 uri = /network-bootstore-config
38282025-03-22T05:15:42.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38292025-03-22T05:15:42.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45419 req_id = f881874f-98b1-4735-a201-e41f8aa6b5f3 response_code = 204 uri = /vpc-routes
38302025-03-22T05:15:42.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5452 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56602 req_id = ab582813-e743-4829-b47d-6f122075ea47 response_code = 200 uri = /v2p
38312025-03-22T05:15:42.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38322025-03-22T05:15:42.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52144 req_id = d2e59b91-e602-447a-babc-4483e8bce290 response_code = 204 uri = /switch-ports
38332025-03-22T05:15:42.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52144 req_id = 3d443362-d406-4a98-86c0-d983568edc42 response_code = 200 uri = /network-bootstore-config
38342025-03-22T05:15:53.721ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51836
38352025-03-22T05:15:53.722ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51836 req_id = 81a9d38f-a55b-49e5-9d70-e1e6fd68ca0e response_code = 200 uri = /baseboard
38362025-03-22T05:16:00.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40904
38372025-03-22T05:16:00.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40904 req_id = 4a09e2ac-e526-420b-9ecf-60de00ceaaa4 response_code = 200 uri = /v2p
38382025-03-22T05:16:00.996ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1626385) }
38392025-03-22T05:16:00.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1424 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40904 req_id = cb522990-d78c-4bfa-9e8d-ac2a826c484b response_code = 204 uri = /v2p
38402025-03-22T05:16:01.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37933
38412025-03-22T05:16:01.185ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1626385))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ebafaaac-16e8-41d5-ad9e-5ad19d3bce7f, slot: 0, read_only: false, vcr_json: .., name: "disk-4dc217b6182" }], boot_settings: Some(InstanceBootSettings { order: [ebafaaac-16e8-41d5-ad9e-5ad19d3bce7f] }), cloud_init_bytes: Some(..) } instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 metadata = InstanceMetadata { silo_id: c4046add-b968-4df5-b096-4b9b10dce559, project_id: 893214e7-0a7c-43ab-b682-b6a6df88812d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-22T05:16:01.169423328Z }
38422025-03-22T05:16:01.185ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 migration_id = None propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38432025-03-22T05:16:01.185ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1717 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 migration_id = None propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1626385))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8d0705e0-b81c-44a9-88d2-11c20e286933, kind: Instance { id: a16dd8e8-388f-4a09-97a1-295ba7635d07 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1626385), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ebafaaac-16e8-41d5-ad9e-5ad19d3bce7f, slot: 0, read_only: false, vcr_json: .., name: "disk-4dc217b6182" }], boot_settings: Some(InstanceBootSettings { order: [ebafaaac-16e8-41d5-ad9e-5ad19d3bce7f] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-22T05:16:01.169423328Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
38442025-03-22T05:16:01.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37933 req_id = 8610a460-a7b9-460f-bd0b-0c09dc2be579 response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e
38452025-03-22T05:16:01.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34194
38462025-03-22T05:16:01.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34194 req_id = 9664b67e-291a-408d-88a2-33e605978208 response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e/state
38472025-03-22T05:16:01.268ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1626385 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
38482025-03-22T05:16:01.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
38492025-03-22T05:16:01.310ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e file = illumos-utils/src/zone.rs:356 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38502025-03-22T05:16:01.334ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e file = illumos-utils/src/zone.rs:394 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38512025-03-22T05:16:01.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57874
38522025-03-22T05:16:01.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57874 req_id = d3673b67-3bb2-455d-91dd-6fca974b794c response_code = 200 uri = /vpc-routes
38532025-03-22T05:16:01.364ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {8d0705e0-b81c-44a9-88d2-11c20e286933: {10.151.1.176: {d37d81dd-4d72-49bb-98ff-de0a42903b55}, 10.151.1.175: {d37d81dd-4d72-49bb-98ff-de0a42903b55}}} }
38542025-03-22T05:16:03.239ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38552025-03-22T05:16:03.240ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e zone file = illumos-utils/src/running_zone.rs:491 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38562025-03-22T05:16:03.420ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 65.438178ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38572025-03-22T05:16:03.516ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 105.709195ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38582025-03-22T05:16:03.652ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 296.771763ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38592025-03-22T05:16:03.964ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 503.498284ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38602025-03-22T05:16:04.484ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 466.638525ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38612025-03-22T05:16:04.975ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 1.383975925s file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38622025-03-22T05:16:06.371ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 970.388097ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38632025-03-22T05:16:07.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43780
38642025-03-22T05:16:07.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40055
38652025-03-22T05:16:07.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40055 req_id = 4bcd14f3-e38b-4d3d-9ec2-0146e98a95cc response_code = 200 uri = /v2p
38662025-03-22T05:16:07.353ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 1.389872532s file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e zone = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
38672025-03-22T05:16:07.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42740
38682025-03-22T05:16:07.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38692025-03-22T05:16:07.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38702025-03-22T05:16:07.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92628 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42740 req_id = add08f0f-002e-41fb-970e-fb35852e4cba response_code = 204 uri = /switch-ports
38712025-03-22T05:16:07.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42740 req_id = fe9d64bd-1fe8-4737-8bb1-7109e6c1cd26 response_code = 200 uri = /network-bootstore-config
38722025-03-22T05:16:08.770ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e file = sled-agent/src/instance.rs:2225 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38732025-03-22T05:16:08.780ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 65.840632ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38742025-03-22T05:16:08.855ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e") failed: Property not found. retry in 133.500184ms file = illumos-utils/src/svc.rs:42 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38752025-03-22T05:16:09.000ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2234 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38762025-03-22T05:16:09.041ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2258 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38772025-03-22T05:16:09.124ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1343 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38782025-03-22T05:16:09.126ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1277 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
38792025-03-22T05:16:09.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2044673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43780 req_id = 7a1499a5-fdba-48d3-b114-eabb897f2364 response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e/state
38802025-03-22T05:16:09.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7762379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57874 req_id = e885c98f-fac3-4e77-986f-b8b2e9d0fa91 response_code = 204 uri = /eip-gateways
38812025-03-22T05:16:09.126ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-22T05:16:09.126394943Z } file = sled-agent/src/instance.rs:904 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38822025-03-22T05:16:09.126ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-22T05:16:09.126394943Z } propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38832025-03-22T05:16:09.126ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-22T05:16:09.126394943Z }, migration_in: None, migration_out: None }
38842025-03-22T05:16:09.170ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-22T05:16:09.170216714Z } file = sled-agent/src/instance.rs:904 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38852025-03-22T05:16:09.170ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-22T05:16:09.170216714Z } propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
38862025-03-22T05:16:09.170ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-22T05:16:09.170216714Z }, migration_in: None, migration_out: None }
38872025-03-22T05:16:09.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57874 req_id = 4f49765b-b6fd-4af7-8ab8-605e66733335 response_code = 204 uri = /vpc-routes
38882025-03-22T05:16:09.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54664
38892025-03-22T05:16:09.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54664 req_id = abf85960-bd7e-47c0-89cb-706e5aa784f0 response_code = 200 uri = /vpc-routes
38902025-03-22T05:16:09.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {8d0705e0-b81c-44a9-88d2-11c20e286933: {10.151.1.175: {d37d81dd-4d72-49bb-98ff-de0a42903b55}, 10.151.1.176: {d37d81dd-4d72-49bb-98ff-de0a42903b55}}} }
38912025-03-22T05:16:09.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54664 req_id = c194407e-4e07-40a8-8041-9f3d109dbd1c response_code = 204 uri = /eip-gateways
38922025-03-22T05:16:09.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54664 req_id = e9648cfd-d3fa-4921-9f90-1c47169c3ca0 response_code = 204 uri = /vpc-routes
38932025-03-22T05:16:09.776ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6021 local_addr = [fd00:1122:3344:101::1]:35639 method = GET remote_addr = [fd00:1122:3344:101::d]:47725 req_id = ccc027c4-3f06-452d-9ed3-0472ca9ae741 response_code = 200 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c uri = /f634dba2-8c5d-4b36-ba71-7efa6e33985c
38942025-03-22T05:16:12.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34385
38952025-03-22T05:16:12.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34385 req_id = f1a4ca2b-0e21-4124-8025-9ebe3ac96a32 response_code = 200 uri = /vpc-routes
38962025-03-22T05:16:12.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {8d0705e0-b81c-44a9-88d2-11c20e286933: {10.151.1.176: {d37d81dd-4d72-49bb-98ff-de0a42903b55}, 10.151.1.175: {d37d81dd-4d72-49bb-98ff-de0a42903b55}}} }
38972025-03-22T05:16:12.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34385 req_id = b6eae4ff-bfed-4a60-b73f-38af033dc3e9 response_code = 204 uri = /eip-gateways
38982025-03-22T05:16:12.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36517
38992025-03-22T05:16:12.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36517 req_id = 962777f4-54b4-449d-bdba-5cfd96938f8e response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e/state
39002025-03-22T05:16:12.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60994
39012025-03-22T05:16:12.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60994 req_id = e6a19bdb-1a3c-43ef-a19d-1d421aa8fc90 response_code = 200 uri = /vpc-routes
39022025-03-22T05:16:12.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51126
39032025-03-22T05:16:12.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51126 req_id = 7c9b73c9-eec7-411a-bde9-e576876d5970 response_code = 200 uri = /v2p
39042025-03-22T05:16:12.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34385 req_id = a8e85be3-0278-43d6-bf3c-ed84596a944d response_code = 204 uri = /vpc-routes
39052025-03-22T05:16:12.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45786
39062025-03-22T05:16:12.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45786 req_id = 27b230e1-4b95-4d49-aa65-9fb413879f6b response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e/state
39072025-03-22T05:16:12.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {8d0705e0-b81c-44a9-88d2-11c20e286933: {10.151.1.176: {d37d81dd-4d72-49bb-98ff-de0a42903b55}, 10.151.1.175: {d37d81dd-4d72-49bb-98ff-de0a42903b55}}} }
39082025-03-22T05:16:12.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60994 req_id = 46a0a062-5723-4e0a-85aa-5e89d66069bb response_code = 204 uri = /eip-gateways
39092025-03-22T05:16:12.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59194
39102025-03-22T05:16:12.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
39112025-03-22T05:16:12.444ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
39122025-03-22T05:16:12.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59194 req_id = f6b673ed-135b-4264-8265-2a59572fc32c response_code = 204 uri = /switch-ports
39132025-03-22T05:16:12.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39683
39142025-03-22T05:16:12.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59194 req_id = f5c9abcf-6961-43d8-a53f-1e7820a8ff03 response_code = 200 uri = /network-bootstore-config
39152025-03-22T05:16:12.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
39162025-03-22T05:16:12.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5607 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60994 req_id = 4730ff64-0483-4ad2-806e-f59b62b1dab3 response_code = 204 uri = /vpc-routes
39172025-03-22T05:16:12.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
39182025-03-22T05:16:12.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40349
39192025-03-22T05:16:12.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40349 req_id = dfa8bf0d-514f-4627-9c0c-cb435574fac9 response_code = 200 uri = /v2p
39202025-03-22T05:16:12.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39683 req_id = 5ff7e147-b258-4b5b-8209-eee97c540d64 response_code = 204 uri = /switch-ports
39212025-03-22T05:16:12.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39683 req_id = 7b00a484-d446-4fe9-a7ef-17a7106bdd60 response_code = 200 uri = /network-bootstore-config
39222025-03-22T05:16:16.725ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
39232025-03-22T05:16:16.726ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
39242025-03-22T05:16:16.726ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
39252025-03-22T05:16:16.726ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
39262025-03-22T05:16:18.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33817
39272025-03-22T05:16:18.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33817 req_id = 7234644b-35b5-46e6-b687-ed628d921b48 response_code = 200 uri = /vmms/4372f80b-a351-4a54-b77d-d1caef3a9f6e/state
39282025-03-22T05:16:18.836ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-22T05:16:18.836764040Z } file = sled-agent/src/instance.rs:904 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39292025-03-22T05:16:18.836ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-22T05:16:18.836764040Z } propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39302025-03-22T05:16:18.836ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-22T05:16:18.836764040Z }, migration_in: None, migration_out: None }
39312025-03-22T05:16:18.846ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-22T05:16:18.846532461Z } file = sled-agent/src/instance.rs:904 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39322025-03-22T05:16:18.846ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-22T05:16:18.846532461Z } propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39332025-03-22T05:16:18.846ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:940 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39342025-03-22T05:16:18.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
39352025-03-22T05:16:18.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
39362025-03-22T05:16:18.846ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6c2d1b67-1f24-400b-ac37-175a47067aad/debug/bundle/zone", "/pool/int/8ec9bd0a-0d25-4e3c-a6c4-3f3a849996e8/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f282df4c-a498-441e-a714-cfa606ade1c7/crypt/debug", "/pool/ext/b47c4962-4319-408d-9df5-7ff4139e32f5/crypt/debug", "/pool/ext/5436dcfe-a58e-4d96-a581-643f03565c69/crypt/debug", "/pool/ext/25a954fe-dd77-4935-9929-93fce92615d1/crypt/debug", "/pool/ext/7461c1f9-7632-471b-95a6-fd6c9e85fd09/crypt/debug", "/pool/ext/1ed71c1a-38c4-4e79-835c-4608b7e5b9a2/crypt/debug", "/pool/ext/7deb16a6-d604-4284-9783-3c07eddc30d2/crypt/debug", "/pool/ext/0218e542-b0d7-4d7c-8d83-2a3abd5381c4/crypt/debug", "/pool/ext/2feb83c9-6c1b-479e-9359-21a5a50a2673/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:354 zone_name = oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e
39372025-03-22T05:16:19.514ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1159 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e", bundle_id: 23ebb45c-d655-4413-82b8-64cd6c51d2b6 }, time_created: 2025-03-22T05:16:18.847916977Z, version: 0, cause: TerminatedInstance }
39382025-03-22T05:16:19.514ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4372f80b-a351-4a54-b77d-d1caef3a9f6e file = sled-agent/src/instance.rs:1444 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39392025-03-22T05:16:21.283ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:310 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39402025-03-22T05:16:21.302ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(1626385), kind: System }
39412025-03-22T05:16:21.302ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(1626385), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
39422025-03-22T05:16:21.303ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-22T05:16:21.303136282Z }, migration_in: None, migration_out: None }
39432025-03-22T05:16:21.326ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-22T05:16:21.303136282Z }, migration_in: None, migration_out: None }
39442025-03-22T05:16:21.330ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1381 instance_id = a16dd8e8-388f-4a09-97a1-295ba7635d07 propolis_id = 4372f80b-a351-4a54-b77d-d1caef3a9f6e
39452025-03-22T05:16:21.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58132
39462025-03-22T05:16:21.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58132 req_id = 82bbbfd7-f16c-4055-b694-da8fc418fb0f response_code = 200 uri = /vpc-routes
39472025-03-22T05:16:21.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
39482025-03-22T05:16:21.866ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1277 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c
39492025-03-22T05:16:21.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58132 req_id = 51cb5bd6-4ee4-45de-9950-615fb93c2664 response_code = 204 uri = /eip-gateways
39502025-03-22T05:16:21.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58132 req_id = 6836eb06-289f-4178-babe-f198f9ec30a8 response_code = 204 uri = /vpc-routes
39512025-03-22T05:16:21.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35634
39522025-03-22T05:16:21.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35634 req_id = b95e94b9-80a3-4019-b95e-4c59e77872a0 response_code = 200 uri = /v2p
39532025-03-22T05:16:22.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43629
39542025-03-22T05:16:22.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43629 req_id = d89d91d7-9e12-45bd-a373-63d6510d3a49 response_code = 200 uri = /v2p
39552025-03-22T05:16:22.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50796
39562025-03-22T05:16:22.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50796 req_id = 8a4a23d3-938a-43b0-9814-cfe016769c8f response_code = 200 uri = /vpc-routes
39572025-03-22T05:16:22.299ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
39582025-03-22T05:16:22.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50796 req_id = 26d1aeb0-78e3-406d-a4ef-857ba6071ee5 response_code = 204 uri = /eip-gateways
39592025-03-22T05:16:22.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50796 req_id = 6f45fbef-f933-4c80-86dd-64de8604eb17 response_code = 204 uri = /vpc-routes
39602025-03-22T05:16:22.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39077
39612025-03-22T05:16:22.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39077 req_id = 1001d31b-b65a-4278-beea-621e846a7659 response_code = 200 uri = /vpc-routes
39622025-03-22T05:16:22.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f634dba2-8c5d-4b36-ba71-7efa6e33985c values = ExternalIpGatewayMap { mappings: {} }
39632025-03-22T05:16:22.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39077 req_id = 3f7eb282-6368-4f22-a2de-96ee843c3575 response_code = 204 uri = /eip-gateways
39642025-03-22T05:16:22.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39077 req_id = 95ff2251-910f-470b-8574-04bc26550b5a response_code = 204 uri = /vpc-routes
39652025-03-22T05:16:23.754ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42261
39662025-03-22T05:16:23.754ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42261 req_id = 232b3f29-b847-4b83-8484-2830108743db response_code = 200 uri = /baseboard