Max level shown:
1 [ Mar 25 21:56:35 Enabled. ]
2 [ Mar 25 21:56:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 25 21:56:35 Method "start" exited with status 0. ]
4 [ Mar 25 21:56:35 Rereading configuration. ]
5 [ Mar 25 21:56:35 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-25T21:56:35.127ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-25T21:56:35.128ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-25T21:56:35.181ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-25T21:56:35.181ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-25T21:56:35.297ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-25T21:56:35.306ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-25T21:56:35.315ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-25T21:56:35.928ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
152025-03-25T21:56:35.929ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }]
162025-03-25T21:56:35.929ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
172025-03-25T21:56:36.065ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-25T21:56:36.065ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-25T21:56:36.065ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-25T21:56:36.065ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
212025-03-25T21:56:36.065ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
222025-03-25T21:56:36.065ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
232025-03-25T21:56:36.068ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-25T21:56:36.068ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-25T21:56:36.068ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-25T21:56:36.068ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-25T21:56:36.068ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-25T21:56:36.068ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-25T21:56:36.068ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-25T21:56:36.068ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-25T21:56:36.068ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-25T21:56:36.080ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-25T21:56:36.081ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool)
342025-03-25T21:56:36.184ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal }
352025-03-25T21:56:36.544ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-25T21:56:36.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-25T21:56:36.545ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-25T21:56:36.545ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-25T21:56:36.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-25T21:56:36.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-25T21:56:36.545ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-25T21:56:36.554ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-25T21:56:36.554ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool)
442025-03-25T21:56:36.643ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal }
452025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
492025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
502025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
542025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
552025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
562025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
582025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
602025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
612025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
622025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
772025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
802025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
812025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
832025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
852025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
872025-03-25T21:56:37.008ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
882025-03-25T21:56:37.008ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892025-03-25T21:56:37.008ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902025-03-25T21:56:37.008ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
912025-03-25T21:56:37.008ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
932025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
942025-03-25T21:56:37.009ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
952025-03-25T21:56:37.009ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:491 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
962025-03-25T21:56:37.009ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
982025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
992025-03-25T21:56:37.009ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-25T21:56:37.009ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1022025-03-25T21:56:37.009ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1032025-03-25T21:56:37.009ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1042025-03-25T21:56:37.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1052025-03-25T21:56:37.009ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1072025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1082025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1092025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1102025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1112025-03-25T21:56:37.009ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1122025-03-25T21:56:37.009ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-25T21:56:37.009ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-25T21:56:37.020ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:803
1152025-03-25T21:56:37.020ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 6550, tv_nsec: 968129447 } time_to_next_cleanup = 599.999920968s
1162025-03-25T21:56:37.020ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4081
1172025-03-25T21:56:37.020ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-25T21:56:37.020ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-25T21:56:37.020ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-25T21:56:37.023ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1212025-03-25T21:56:37.025ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1222025-03-25T21:56:37.025ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1136
1232025-03-25T21:56:37.025ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-25T21:56:37.025ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-25T21:56:37.025ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-25T21:56:37.025ZINFOSledAgent (RSS): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-25T21:56:37.025ZINFOSledAgent (RSS): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-25T21:56:37.025ZINFOSledAgent (RSS): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-25T21:56:37.025ZINFOSledAgent (RSS): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-25T21:56:37.025ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1185
1312025-03-25T21:56:37.025ZINFOSledAgent (RSS): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-25T21:56:37.025ZINFOSledAgent (RSS): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-25T21:56:37.025ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1217
1342025-03-25T21:56:37.025ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-25T21:56:37.025ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-25T21:56:37.025ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1248
1372025-03-25T21:56:37.026ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382025-03-25T21:56:37.026ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1392025-03-25T21:56:37.026ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1402025-03-25T21:56:37.026ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412025-03-25T21:56:37.026ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f034aaf6-2037-4cb4-8409-3ab31c15cc28 (sled), rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422025-03-25T21:56:37.028ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4378
1432025-03-25T21:56:37.028ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4799
1442025-03-25T21:56:37.032ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-25T21:56:37.038ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-25T21:56:37.038ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-25T21:56:37.043ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-25T21:56:37.043ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-25T21:56:37.043ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44538
1502025-03-25T21:56:37.043ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f034aaf6-2037-4cb4-8409-3ab31c15cc28 (sled), rack_id: c7210e4b-5a81-4ec8-b8fe-816a9508dc74, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:356
1512025-03-25T21:56:37.043ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:371
1522025-03-25T21:56:37.043ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-25T21:56:37.043ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1552025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-25T21:56:37.043ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
1622025-03-25T21:56:37.043ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-25T21:56:37.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-25T21:56:37.083ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:356
1652025-03-25T21:56:37.101ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:394
1662025-03-25T21:56:37.107ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1672025-03-25T21:56:37.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1682025-03-25T21:56:37.107ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1692025-03-25T21:56:37.107ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
1702025-03-25T21:56:37.110ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "311ae279-512c-4559-9d5f-2826e4400477", "content-length": "124", "date": "Tue, 25 Mar 2025 21:56:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "311ae279-512c-4559-9d5f-2826e4400477" } file = sled-agent/src/ddm_reconciler.rs:206
1712025-03-25T21:56:37.110ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
1722025-03-25T21:56:37.111ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1732025-03-25T21:56:37.111ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
1742025-03-25T21:56:37.121ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f80f2cdc-0e38-40dd-8afe-efcd7214bccc/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-25T21:56:37.144ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f80f2cdc-0e38-40dd-8afe-efcd7214bccc/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-25T21:56:37.145ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f80f2cdc-0e38-40dd-8afe-efcd7214bccc/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-25T21:56:37.150ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1782025-03-25T21:56:37.150ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-25T21:56:37.150ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f80f2cdc-0e38-40dd-8afe-efcd7214bccc/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-25T21:56:37.220ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-25T21:56:37.440ZINFOSledAgent (BackingFs): Mounting oxi_f80f2cdc-0e38-40dd-8afe-efcd7214bccc/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-25T21:56:37.453ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-25T21:56:37.453ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-25T21:56:37.453ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-25T21:56:37.453ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-25T21:56:38.195ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1872025-03-25T21:56:38.200ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:56707 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1882025-03-25T21:56:38.201ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1892025-03-25T21:56:38.201ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:56707 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1902025-03-25T21:56:38.202ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 319.051645ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1912025-03-25T21:56:38.203ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1922025-03-25T21:56:38.203ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1932025-03-25T21:56:38.203ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:990 underlay_address = fd00:1122:3344:101::1
1942025-03-25T21:56:38.203ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-25T21:56:38.521ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 580.404733ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1962025-03-25T21:56:39.104ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.40864125s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1972025-03-25T21:56:40.515ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.396957469s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
1982025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2757
1992025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2987
2002025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2627
2012025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2674
2022025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3068
2032025-03-25T21:56:41.071ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3113
2042025-03-25T21:56:41.073ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2895
2052025-03-25T21:56:41.075ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2668
2062025-03-25T21:56:41.075ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0b8a959d-46b0-4518-942d-822ef52c9394'/> <propval type="astring" name="rack_id" value='c7210e4b-5a81-4ec8-b8fe-816a9508dc74'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feb7:8167'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='c7210e4b-5a81-4ec8-b8fe-816a9508dc74'/> <propval type="astring" name="sled_id" value='f034aaf6-2037-4cb4-8409-3ab31c15cc28'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='c7210e4b-5a81-4ec8-b8fe-816a9508dc74'/> <propval type="astring" name="sled_id" value='f034aaf6-2037-4cb4-8409-3ab31c15cc28'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='f034aaf6-2037-4cb4-8409-3ab31c15cc28'/> <propval type="astring" name="rack_uuid" value='c7210e4b-5a81-4ec8-b8fe-816a9508dc74'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='f034aaf6-2037-4cb4-8409-3ab31c15cc28'/> <propval type="astring" name="rack_uuid" value='c7210e4b-5a81-4ec8-b8fe-816a9508dc74'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2072025-03-25T21:56:41.075ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2082025-03-25T21:56:41.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 31.497198ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2092025-03-25T21:56:41.590ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 116.50295ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-25T21:56:41.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 134.73497ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-25T21:56:41.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 536.961531ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-25T21:56:42.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 808.215254ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-03-25T21:56:42.915ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.810099826s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2142025-03-25T21:56:43.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 697.914932ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-25T21:56:44.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.389414857s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-25T21:56:45.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.356623278s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-25T21:56:46.727ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.338660513s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2182025-03-25T21:56:47.709ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2192025-03-25T21:56:47.709ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2202025-03-25T21:56:47.709ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2212025-03-25T21:56:47.742ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2222025-03-25T21:56:47.743ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/nexus.rs:530 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2232025-03-25T21:56:47.743ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2242025-03-25T21:56:47.743ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:411
2252025-03-25T21:56:47.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-03-25T21:56:47.743ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2272025-03-25T21:56:47.743ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2282025-03-25T21:56:47.743ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2292025-03-25T21:56:47.744ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2302025-03-25T21:56:47.744ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4081
2312025-03-25T21:56:47.744ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44538
2322025-03-25T21:56:47.905ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2332025-03-25T21:56:47.905ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2342025-03-25T21:56:47.910ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4402 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2352025-03-25T21:56:47.910ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4418
2362025-03-25T21:56:47.910ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2372025-03-25T21:56:48.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64516
2382025-03-25T21:56:48.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2392025-03-25T21:56:48.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2402025-03-25T21:56:48.155ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:186
2412025-03-25T21:56:48.155ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:186
2422025-03-25T21:56:48.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64516 req_id = 10644bf2-2363-418a-bd6a-d9e0b43a0f64 response_code = 200 uri = /inventory
2432025-03-25T21:56:48.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36703
2442025-03-25T21:56:48.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36703 req_id = cc9535ec-d8bc-404e-9747-a123e9a4606e response_code = 200 uri = /sled-role
2452025-03-25T21:56:48.206ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2462025-03-25T21:56:48.206ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2472025-03-25T21:56:48.219ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(2), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5533f428-2028-4269-b7b1-f15912c01133 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 66b022b6-2e12-413e-b4b7-56c4ad5bdd77 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: f337d25b-c67a-4a32-89e1-e187aea97ed9 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }] }
2482025-03-25T21:56:48.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41804
2492025-03-25T21:56:48.220ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2502025-03-25T21:56:48.220ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2512025-03-25T21:56:48.220ZINFOSledAgent (StorageManager): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2522025-03-25T21:56:48.220ZINFOSledAgent (StorageManager): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2532025-03-25T21:56:48.220ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1302 request = omicron_physical_disks_ensure
2542025-03-25T21:56:48.220ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
2552025-03-25T21:56:48.220ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
2562025-03-25T21:56:48.220ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2572025-03-25T21:56:48.220ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2582025-03-25T21:56:48.347ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2592025-03-25T21:56:48.347ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool)
2602025-03-25T21:56:48.530ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2612025-03-25T21:56:48.628ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }
2622025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2632025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2642025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2652025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2662025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2672025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2682025-03-25T21:56:48.637ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2692025-03-25T21:56:48.675ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2702025-03-25T21:56:48.683ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone file = sled-storage/src/dataset.rs:304
2712025-03-25T21:56:48.745ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
2722025-03-25T21:56:48.824ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c file = sled-storage/src/dataset.rs:390
2732025-03-25T21:56:48.833ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:456
2742025-03-25T21:56:48.833ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2752025-03-25T21:56:48.833ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
2762025-03-25T21:56:48.833ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2772025-03-25T21:56:48.833ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2782025-03-25T21:56:48.843ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2792025-03-25T21:56:48.843ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool)
2802025-03-25T21:56:48.939ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }
2812025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2822025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2832025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2842025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2852025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872025-03-25T21:56:48.948ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2882025-03-25T21:56:48.983ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2892025-03-25T21:56:48.991ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone file = sled-storage/src/dataset.rs:304
2902025-03-25T21:56:49.131ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d file = sled-storage/src/dataset.rs:390
2912025-03-25T21:56:49.140ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:456
2922025-03-25T21:56:49.140ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2932025-03-25T21:56:49.140ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
2942025-03-25T21:56:49.140ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
2952025-03-25T21:56:49.140ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2962025-03-25T21:56:49.150ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2972025-03-25T21:56:49.150ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f92ee940-58a4-42f3-8249-a9824705ae7b (zpool)
2982025-03-25T21:56:49.247ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }
2992025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
3002025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
3012025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3022025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3032025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3042025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3052025-03-25T21:56:49.256ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3062025-03-25T21:56:49.292ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3072025-03-25T21:56:49.300ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone file = sled-storage/src/dataset.rs:304
3082025-03-25T21:56:49.442ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f92ee940-58a4-42f3-8249-a9824705ae7b file = sled-storage/src/dataset.rs:390
3092025-03-25T21:56:49.450ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:456
3102025-03-25T21:56:49.450ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3112025-03-25T21:56:49.450ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
3122025-03-25T21:56:49.450ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3132025-03-25T21:56:49.450ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3142025-03-25T21:56:49.460ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3152025-03-25T21:56:49.460ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool)
3162025-03-25T21:56:49.557ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }
3172025-03-25T21:56:49.565ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3182025-03-25T21:56:49.565ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3192025-03-25T21:56:49.565ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3202025-03-25T21:56:49.565ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3212025-03-25T21:56:49.565ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3222025-03-25T21:56:49.566ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3232025-03-25T21:56:49.566ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3242025-03-25T21:56:49.604ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3252025-03-25T21:56:49.612ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone file = sled-storage/src/dataset.rs:304
3262025-03-25T21:56:49.747ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
3272025-03-25T21:56:49.749ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c file = sled-storage/src/dataset.rs:390
3282025-03-25T21:56:49.758ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:456
3292025-03-25T21:56:49.758ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3302025-03-25T21:56:49.758ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
3312025-03-25T21:56:49.758ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3322025-03-25T21:56:49.758ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3332025-03-25T21:56:49.768ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3342025-03-25T21:56:49.768ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool)
3352025-03-25T21:56:49.866ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }
3362025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3372025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3382025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3392025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3402025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3412025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3422025-03-25T21:56:49.874ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3432025-03-25T21:56:49.910ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442025-03-25T21:56:49.918ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/zone file = sled-storage/src/dataset.rs:304
3452025-03-25T21:56:50.052ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01 file = sled-storage/src/dataset.rs:390
3462025-03-25T21:56:50.061ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:456
3472025-03-25T21:56:50.061ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3482025-03-25T21:56:50.061ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
3492025-03-25T21:56:50.061ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3502025-03-25T21:56:50.061ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3512025-03-25T21:56:50.071ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3522025-03-25T21:56:50.071ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool)
3532025-03-25T21:56:50.161ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }
3542025-03-25T21:56:50.168ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3552025-03-25T21:56:50.168ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3562025-03-25T21:56:50.169ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3572025-03-25T21:56:50.169ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3582025-03-25T21:56:50.169ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3592025-03-25T21:56:50.169ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3602025-03-25T21:56:50.169ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3612025-03-25T21:56:50.205ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3622025-03-25T21:56:50.213ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/zone file = sled-storage/src/dataset.rs:304
3632025-03-25T21:56:50.350ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71 file = sled-storage/src/dataset.rs:390
3642025-03-25T21:56:50.358ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:456
3652025-03-25T21:56:50.358ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3662025-03-25T21:56:50.358ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
3672025-03-25T21:56:50.358ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3682025-03-25T21:56:50.358ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3692025-03-25T21:56:50.369ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3702025-03-25T21:56:50.369ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool)
3712025-03-25T21:56:50.467ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }
3722025-03-25T21:56:50.475ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3732025-03-25T21:56:50.475ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3742025-03-25T21:56:50.475ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3752025-03-25T21:56:50.476ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3762025-03-25T21:56:50.476ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3772025-03-25T21:56:50.476ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3782025-03-25T21:56:50.476ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3792025-03-25T21:56:50.510ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3802025-03-25T21:56:50.518ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone file = sled-storage/src/dataset.rs:304
3812025-03-25T21:56:50.657ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8 file = sled-storage/src/dataset.rs:390
3822025-03-25T21:56:50.665ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:456
3832025-03-25T21:56:50.665ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3842025-03-25T21:56:50.665ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
3852025-03-25T21:56:50.665ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
3862025-03-25T21:56:50.665ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3872025-03-25T21:56:50.675ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3882025-03-25T21:56:50.675ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool)
3892025-03-25T21:56:50.772ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }
3902025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3912025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3922025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3932025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3942025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3952025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3962025-03-25T21:56:50.780ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3972025-03-25T21:56:50.784ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
3982025-03-25T21:56:50.817ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992025-03-25T21:56:50.829ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone file = sled-storage/src/dataset.rs:304
4002025-03-25T21:56:50.974ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9cb403e6-797e-4379-973b-713f596fb1b1 file = sled-storage/src/dataset.rs:390
4012025-03-25T21:56:50.982ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:456
4022025-03-25T21:56:50.982ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
4032025-03-25T21:56:50.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
4042025-03-25T21:56:50.982ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:435
4052025-03-25T21:56:50.982ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4062025-03-25T21:56:50.993ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4072025-03-25T21:56:50.993ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool)
4082025-03-25T21:56:51.092ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }
4092025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4102025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4112025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4122025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4132025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4142025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4152025-03-25T21:56:51.101ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4162025-03-25T21:56:51.144ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4172025-03-25T21:56:51.152ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone file = sled-storage/src/dataset.rs:304
4182025-03-25T21:56:51.291ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126 file = sled-storage/src/dataset.rs:390
4192025-03-25T21:56:51.300ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:456
4202025-03-25T21:56:51.300ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4212025-03-25T21:56:51.300ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4222025-03-25T21:56:51.300ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4232025-03-25T21:56:51.300ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4242025-03-25T21:56:51.300ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4252025-03-25T21:56:51.300ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4262025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4272025-03-25T21:56:51.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4282025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4292025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4302025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4312025-03-25T21:56:51.300ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4322025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4332025-03-25T21:56:51.300ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4342025-03-25T21:56:51.300ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4352025-03-25T21:56:51.300ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4362025-03-25T21:56:51.301ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(2), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4372025-03-25T21:56:51.301ZINFOSledAgent (StorageManager): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4382025-03-25T21:56:51.301ZINFOSledAgent (StorageManager): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-25T21:56:51.301ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4402025-03-25T21:56:51.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4412025-03-25T21:56:51.316ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4422025-03-25T21:56:51.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone" } file = sled-storage/src/manager.rs:1434
4432025-03-25T21:56:51.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4442025-03-25T21:56:51.345ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4452025-03-25T21:56:51.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crucible" } file = sled-storage/src/manager.rs:1434
4462025-03-25T21:56:51.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4472025-03-25T21:56:51.393ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4482025-03-25T21:56:51.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } file = sled-storage/src/manager.rs:1434
4492025-03-25T21:56:51.451ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4502025-03-25T21:56:51.451ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4512025-03-25T21:56:51.451ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/zone/oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a"), full_name: "oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/zone/oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } file = sled-storage/src/manager.rs:1434
4522025-03-25T21:56:51.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4532025-03-25T21:56:51.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4542025-03-25T21:56:51.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
4552025-03-25T21:56:51.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4562025-03-25T21:56:51.559ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4572025-03-25T21:56:51.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/debug"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/debug" } file = sled-storage/src/manager.rs:1434
4582025-03-25T21:56:51.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4592025-03-25T21:56:51.587ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4602025-03-25T21:56:51.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } file = sled-storage/src/manager.rs:1434
4612025-03-25T21:56:51.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4622025-03-25T21:56:51.648ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4632025-03-25T21:56:51.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone/oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da"), full_name: "oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone/oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } file = sled-storage/src/manager.rs:1434
4642025-03-25T21:56:51.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4652025-03-25T21:56:51.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4662025-03-25T21:56:51.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } file = sled-storage/src/manager.rs:1434
4672025-03-25T21:56:51.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4682025-03-25T21:56:51.770ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4692025-03-25T21:56:51.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone/oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone/oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } file = sled-storage/src/manager.rs:1434
4702025-03-25T21:56:51.787ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
4712025-03-25T21:56:51.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-25T21:56:51.830ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4732025-03-25T21:56:51.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crucible" } file = sled-storage/src/manager.rs:1434
4742025-03-25T21:56:51.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-25T21:56:51.880ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4762025-03-25T21:56:51.880ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
4772025-03-25T21:56:51.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-25T21:56:51.930ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4792025-03-25T21:56:51.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } file = sled-storage/src/manager.rs:1434
4802025-03-25T21:56:51.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4812025-03-25T21:56:51.991ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4822025-03-25T21:56:51.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crucible" } file = sled-storage/src/manager.rs:1434
4832025-03-25T21:56:52.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4842025-03-25T21:56:52.039ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4852025-03-25T21:56:52.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } file = sled-storage/src/manager.rs:1434
4862025-03-25T21:56:52.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-25T21:56:52.098ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4882025-03-25T21:56:52.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
4892025-03-25T21:56:52.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-25T21:56:52.147ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4912025-03-25T21:56:52.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/zone"), full_name: "oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/zone" } file = sled-storage/src/manager.rs:1434
4922025-03-25T21:56:52.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-25T21:56:52.176ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4942025-03-25T21:56:52.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crucible" } file = sled-storage/src/manager.rs:1434
4952025-03-25T21:56:52.224ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-25T21:56:52.224ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4972025-03-25T21:56:52.224ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } file = sled-storage/src/manager.rs:1434
4982025-03-25T21:56:52.285ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4992025-03-25T21:56:52.285ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5002025-03-25T21:56:52.285ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crucible" } file = sled-storage/src/manager.rs:1434
5012025-03-25T21:56:52.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5022025-03-25T21:56:52.334ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5032025-03-25T21:56:52.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/debug"), full_name: "oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/debug" } file = sled-storage/src/manager.rs:1434
5042025-03-25T21:56:52.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5052025-03-25T21:56:52.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5062025-03-25T21:56:52.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } file = sled-storage/src/manager.rs:1434
5072025-03-25T21:56:52.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5082025-03-25T21:56:52.423ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5092025-03-25T21:56:52.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/debug"), full_name: "oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/debug" } file = sled-storage/src/manager.rs:1434
5102025-03-25T21:56:52.452ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5112025-03-25T21:56:52.452ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5122025-03-25T21:56:52.452ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/debug"), full_name: "oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/debug" } file = sled-storage/src/manager.rs:1434
5132025-03-25T21:56:52.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5142025-03-25T21:56:52.480ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5152025-03-25T21:56:52.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/debug"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/debug" } file = sled-storage/src/manager.rs:1434
5162025-03-25T21:56:52.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5172025-03-25T21:56:52.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5182025-03-25T21:56:52.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } file = sled-storage/src/manager.rs:1434
5192025-03-25T21:56:52.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5202025-03-25T21:56:52.569ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5212025-03-25T21:56:52.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/debug"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/debug" } file = sled-storage/src/manager.rs:1434
5222025-03-25T21:56:52.599ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5232025-03-25T21:56:52.599ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5242025-03-25T21:56:52.599ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/debug"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/debug" } file = sled-storage/src/manager.rs:1434
5252025-03-25T21:56:52.628ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5262025-03-25T21:56:52.628ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5272025-03-25T21:56:52.628ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } file = sled-storage/src/manager.rs:1434
5282025-03-25T21:56:52.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5292025-03-25T21:56:52.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5302025-03-25T21:56:52.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone/oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308"), full_name: "oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone/oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } file = sled-storage/src/manager.rs:1434
5312025-03-25T21:56:52.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5322025-03-25T21:56:52.747ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5332025-03-25T21:56:52.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crucible" } file = sled-storage/src/manager.rs:1434
5342025-03-25T21:56:52.789ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
5352025-03-25T21:56:52.796ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5362025-03-25T21:56:52.796ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5372025-03-25T21:56:52.796ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5382025-03-25T21:56:52.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5392025-03-25T21:56:52.846ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5402025-03-25T21:56:52.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone/oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858"), full_name: "oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone/oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } file = sled-storage/src/manager.rs:1434
5412025-03-25T21:56:52.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5422025-03-25T21:56:52.908ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5432025-03-25T21:56:52.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } file = sled-storage/src/manager.rs:1434
5442025-03-25T21:56:52.969ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5452025-03-25T21:56:52.969ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5462025-03-25T21:56:52.969ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone/oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931"), full_name: "oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone/oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } file = sled-storage/src/manager.rs:1434
5472025-03-25T21:56:53.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5482025-03-25T21:56:53.027ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5492025-03-25T21:56:53.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } file = sled-storage/src/manager.rs:1434
5502025-03-25T21:56:53.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5512025-03-25T21:56:53.086ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5522025-03-25T21:56:53.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/external_dns" } file = sled-storage/src/manager.rs:1434
5532025-03-25T21:56:53.135ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5542025-03-25T21:56:53.135ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5552025-03-25T21:56:53.135ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } file = sled-storage/src/manager.rs:1434
5562025-03-25T21:56:53.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5572025-03-25T21:56:53.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5582025-03-25T21:56:53.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } file = sled-storage/src/manager.rs:1434
5592025-03-25T21:56:53.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5602025-03-25T21:56:53.255ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5612025-03-25T21:56:53.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crucible" } file = sled-storage/src/manager.rs:1434
5622025-03-25T21:56:53.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5632025-03-25T21:56:53.302ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5642025-03-25T21:56:53.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone/oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } file = sled-storage/src/manager.rs:1434
5652025-03-25T21:56:53.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5662025-03-25T21:56:53.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5672025-03-25T21:56:53.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5682025-03-25T21:56:53.410ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5692025-03-25T21:56:53.410ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5702025-03-25T21:56:53.410ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } file = sled-storage/src/manager.rs:1434
5712025-03-25T21:56:53.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5722025-03-25T21:56:53.471ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5732025-03-25T21:56:53.471ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } file = sled-storage/src/manager.rs:1434
5742025-03-25T21:56:53.533ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5752025-03-25T21:56:53.533ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5762025-03-25T21:56:53.533ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
5772025-03-25T21:56:53.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5782025-03-25T21:56:53.582ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5792025-03-25T21:56:53.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/debug"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/debug" } file = sled-storage/src/manager.rs:1434
5802025-03-25T21:56:53.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5812025-03-25T21:56:53.612ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5822025-03-25T21:56:53.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone" } file = sled-storage/src/manager.rs:1434
5832025-03-25T21:56:53.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5842025-03-25T21:56:53.641ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5852025-03-25T21:56:53.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone/oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone/oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } file = sled-storage/src/manager.rs:1434
5862025-03-25T21:56:53.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5872025-03-25T21:56:53.704ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5882025-03-25T21:56:53.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/debug"), full_name: "oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/debug" } file = sled-storage/src/manager.rs:1434
5892025-03-25T21:56:53.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5902025-03-25T21:56:53.733ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5912025-03-25T21:56:53.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone" } file = sled-storage/src/manager.rs:1434
5922025-03-25T21:56:53.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5932025-03-25T21:56:53.764ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5942025-03-25T21:56:53.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/zone/oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } file = sled-storage/src/manager.rs:1434
5952025-03-25T21:56:53.791ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
5962025-03-25T21:56:53.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5972025-03-25T21:56:53.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5982025-03-25T21:56:53.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1434
5992025-03-25T21:56:53.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6002025-03-25T21:56:53.876ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6012025-03-25T21:56:53.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/zone"), full_name: "oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/zone" } file = sled-storage/src/manager.rs:1434
6022025-03-25T21:56:53.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6032025-03-25T21:56:53.905ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6042025-03-25T21:56:53.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone"), full_name: "oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/zone" } file = sled-storage/src/manager.rs:1434
6052025-03-25T21:56:53.935ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6062025-03-25T21:56:53.935ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6072025-03-25T21:56:53.935ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crucible" } file = sled-storage/src/manager.rs:1434
6082025-03-25T21:56:53.984ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6092025-03-25T21:56:53.984ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6102025-03-25T21:56:53.984ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } file = sled-storage/src/manager.rs:1434
6112025-03-25T21:56:54.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6122025-03-25T21:56:54.043ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6132025-03-25T21:56:54.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone"), full_name: "oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/zone" } file = sled-storage/src/manager.rs:1434
6142025-03-25T21:56:54.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6152025-03-25T21:56:54.072ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6162025-03-25T21:56:54.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/zone/oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } file = sled-storage/src/manager.rs:1434
6172025-03-25T21:56:54.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6182025-03-25T21:56:54.132ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6192025-03-25T21:56:54.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/zone/oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110"), full_name: "oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/zone/oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } file = sled-storage/src/manager.rs:1434
6202025-03-25T21:56:54.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6212025-03-25T21:56:54.195ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6222025-03-25T21:56:54.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crypt/clickhouse" } file = sled-storage/src/manager.rs:1434
6232025-03-25T21:56:54.245ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6242025-03-25T21:56:54.245ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6252025-03-25T21:56:54.245ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1434
6262025-03-25T21:56:54.295ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6272025-03-25T21:56:54.295ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6282025-03-25T21:56:54.295ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/zone" } file = sled-storage/src/manager.rs:1434
6292025-03-25T21:56:54.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6302025-03-25T21:56:54.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6312025-03-25T21:56:54.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d"), full_name: "oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/zone/oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } file = sled-storage/src/manager.rs:1434
6322025-03-25T21:56:54.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6332025-03-25T21:56:54.388ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6342025-03-25T21:56:54.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crucible" } file = sled-storage/src/manager.rs:1434
6352025-03-25T21:56:54.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6362025-03-25T21:56:54.436ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6372025-03-25T21:56:54.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/external_dns" } file = sled-storage/src/manager.rs:1434
6382025-03-25T21:56:54.486ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6392025-03-25T21:56:54.486ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6402025-03-25T21:56:54.486ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone"), full_name: "oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/zone" } file = sled-storage/src/manager.rs:1434
6412025-03-25T21:56:54.516ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6422025-03-25T21:56:54.516ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6432025-03-25T21:56:54.516ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
6442025-03-25T21:56:54.516ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6452025-03-25T21:56:54.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6462025-03-25T21:56:54.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6472025-03-25T21:56:54.526ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6482025-03-25T21:56:54.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6492025-03-25T21:56:54.536ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502025-03-25T21:56:54.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6512025-03-25T21:56:54.545ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:186
6522025-03-25T21:56:54.545ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:186
6532025-03-25T21:56:54.545ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6542025-03-25T21:56:54.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6552025-03-25T21:56:54.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6562025-03-25T21:56:54.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6572025-03-25T21:56:54.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6582025-03-25T21:56:54.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133 file = illumos-utils/src/zone.rs:356
6592025-03-25T21:56:54.646ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9 file = illumos-utils/src/zone.rs:356
6602025-03-25T21:56:54.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77 file = illumos-utils/src/zone.rs:356
6612025-03-25T21:56:54.662ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133 file = illumos-utils/src/zone.rs:394
6622025-03-25T21:56:54.666ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9 file = illumos-utils/src/zone.rs:394
6632025-03-25T21:56:54.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77 file = illumos-utils/src/zone.rs:394
6642025-03-25T21:56:54.794ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
6652025-03-25T21:56:55.795ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f034aaf6-2037-4cb4-8409-3ab31c15cc28) file = sled-agent/src/probe_manager.rs:234 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
6662025-03-25T21:56:56.372ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6672025-03-25T21:56:56.372ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
6682025-03-25T21:56:56.373ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
6692025-03-25T21:56:56.378ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
6702025-03-25T21:56:56.379ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
6712025-03-25T21:56:56.861ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6722025-03-25T21:56:57.346ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732025-03-25T21:56:57.347ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
6742025-03-25T21:56:57.351ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:253 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }]
6752025-03-25T21:56:57.351ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:285 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
6762025-03-25T21:56:57.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 74.948801ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
6772025-03-25T21:56:57.357ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
6782025-03-25T21:56:57.361ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
6792025-03-25T21:56:57.370ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4426
6802025-03-25T21:56:57.370ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4436 gateway = fd00:1122:3344:101::1
6812025-03-25T21:56:57.378ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4450 gateway = fd00:1122:3344:101::1
6822025-03-25T21:56:57.378ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4515
6832025-03-25T21:56:57.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 118.124013ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
6842025-03-25T21:56:57.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 42.960907ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
6852025-03-25T21:56:57.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 29.078584ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
6862025-03-25T21:56:57.545ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4556
6872025-03-25T21:56:57.545ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4589
6882025-03-25T21:56:57.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 87.41937ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
6892025-03-25T21:56:57.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 104.337673ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
6902025-03-25T21:56:57.571ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 117.19355ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
6912025-03-25T21:56:57.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
6922025-03-25T21:56:57.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
6932025-03-25T21:56:57.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 106.078286ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
6942025-03-25T21:56:57.873ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4602
6952025-03-25T21:56:57.873ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4467
6962025-03-25T21:56:57.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 450.636934ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
6972025-03-25T21:56:57.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 244.917189ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
6982025-03-25T21:56:58.006ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 481.593871ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
6992025-03-25T21:56:58.034ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4509
7002025-03-25T21:56:58.034ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4566 rack_subnet = fd00:1122:3344::
7012025-03-25T21:56:58.084ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4577
7022025-03-25T21:56:58.084ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4659
7032025-03-25T21:56:58.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 290.645113ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7042025-03-25T21:56:58.180ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4691
7052025-03-25T21:56:58.180ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4697
7062025-03-25T21:56:58.211ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
7072025-03-25T21:56:58.212ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
7082025-03-25T21:56:58.299ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4738
7092025-03-25T21:56:58.299ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4608
7102025-03-25T21:56:58.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 436.483314ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
7112025-03-25T21:56:58.406ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4641
7122025-03-25T21:56:58.406ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7132025-03-25T21:56:58.441ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7142025-03-25T21:56:58.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 580.761408ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7152025-03-25T21:56:58.477ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7162025-03-25T21:56:58.477ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7172025-03-25T21:56:58.478ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7182025-03-25T21:56:58.478ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7192025-03-25T21:56:58.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
7202025-03-25T21:56:58.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 579.328672ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7212025-03-25T21:56:58.586ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7222025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:569 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-03-25T21:56:58.586ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:590 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442025-03-25T21:56:58.786ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 1.406316172s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
7452025-03-25T21:56:59.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 826.706217ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7462025-03-25T21:56:59.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 782.818608ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7472025-03-25T21:56:59.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 1.100088752s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7482025-03-25T21:56:59.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 1.104593119s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7492025-03-25T21:57:00.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 1.022881126s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
7502025-03-25T21:57:00.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9") failed: Property not found. retry in 1.425045898s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7512025-03-25T21:57:01.017ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 1.248358548s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7522025-03-25T21:57:01.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133") failed: Property not found. retry in 1.31058416s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
7532025-03-25T21:57:02.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77") failed: Property not found. retry in 530.46357ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7542025-03-25T21:57:02.827ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133
7552025-03-25T21:57:02.827ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9
7562025-03-25T21:57:02.827ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77
7572025-03-25T21:57:02.827ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7582025-03-25T21:57:02.827ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7592025-03-25T21:57:02.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 14608326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41804 req_id = 4ed11bfa-0e0f-4bf1-979d-d766b1654824 response_code = 200 uri = /omicron-config
7602025-03-25T21:57:02.830ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7612025-03-25T21:57:02.975ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 129.212607ms) dns_config_addr = [fd00:1122:3344:3::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:3::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:626
7622025-03-25T21:57:03.129ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7632025-03-25T21:57:04.310ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:606
7642025-03-25T21:57:04.359ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:642
7652025-03-25T21:57:04.360ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7662025-03-25T21:57:04.392ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7672025-03-25T21:57:04.393ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7682025-03-25T21:57:04.393ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7692025-03-25T21:57:04.423ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(3), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(3), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5533f428-2028-4269-b7b1-f15912c01133 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 66b022b6-2e12-413e-b4b7-56c4ad5bdd77 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: f337d25b-c67a-4a32-89e1-e187aea97ed9 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b150a584-3fda-41cb-98cf-f12598e3f20c, kind: Service { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d }, name: Name("ntp-834363ac-29cb-47d1-b5b5-9a2185c31d2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 139])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] }
7702025-03-25T21:57:04.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54640
7712025-03-25T21:57:04.424ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
7722025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(3), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
7732025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
7742025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
7752025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
7762025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
7772025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
7782025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
7792025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
7802025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
7812025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
7822025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
7832025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
7842025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
7852025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
7862025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
7872025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
7882025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
7892025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
7902025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
7912025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
7922025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
7932025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
7942025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
7952025-03-25T21:57:04.424ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
7962025-03-25T21:57:04.424ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
7972025-03-25T21:57:04.424ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(3), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
7982025-03-25T21:57:04.425ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
7992025-03-25T21:57:04.425ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
8002025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
8012025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8022025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8032025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(3) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8042025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8052025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8062025-03-25T21:57:04.425ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(3) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8072025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8082025-03-25T21:57:04.425ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(3)
8092025-03-25T21:57:04.425ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8102025-03-25T21:57:04.425ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
8112025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(3), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
8122025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
8132025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
8142025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
8152025-03-25T21:57:04.425ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(2) request = datasets_ensure requested_generation = Generation(3)
8162025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8172025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8182025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8192025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8202025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8212025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8222025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8232025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8242025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8252025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8262025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8272025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8282025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8292025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8302025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8312025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8322025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8332025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8342025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8352025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8362025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8372025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8382025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8392025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8402025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8412025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8422025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8432025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8442025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8452025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8462025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8472025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8482025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8492025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8502025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8512025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8522025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8532025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8542025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8552025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8562025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8572025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8582025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8592025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8602025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8612025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8622025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8632025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8642025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8652025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8662025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8672025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8682025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8692025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8702025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8712025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8722025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8732025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8742025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8752025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8762025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8772025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8782025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8792025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8802025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8812025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8822025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8832025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8842025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8852025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8862025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8872025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8882025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8892025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8902025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8912025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8922025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
8932025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8942025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8952025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8962025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
8972025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
8982025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
8992025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9002025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9012025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9022025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9032025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9042025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9052025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9062025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9072025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9082025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9092025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9102025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9112025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9122025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9132025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9142025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9152025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9162025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9172025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9182025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9192025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9202025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9212025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9222025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9232025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9242025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9252025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9262025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9272025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9282025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9292025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9302025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9312025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9322025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9332025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9342025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9352025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9362025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9372025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9382025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9392025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9402025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9412025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9422025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9432025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9442025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9452025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9462025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9472025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9482025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9492025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9502025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9512025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9522025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
9532025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9542025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9552025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9562025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9572025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9582025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9592025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9602025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9612025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
9622025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9632025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9642025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9652025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9662025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9672025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9682025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9692025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9702025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9712025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9722025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9732025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9742025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9752025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9762025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9772025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9782025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9792025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9802025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9812025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9822025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9832025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9842025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9852025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9862025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9872025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9882025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9892025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9902025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9912025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9922025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9932025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9942025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9952025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9962025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
9972025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
9982025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
9992025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10002025-03-25T21:57:04.456ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10012025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10022025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10032025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10042025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10052025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10062025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10072025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10082025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10092025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10102025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10112025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
10122025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
10132025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
10142025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
10152025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
10162025-03-25T21:57:04.457ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10172025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10182025-03-25T21:57:04.457ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10192025-03-25T21:57:04.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10202025-03-25T21:57:04.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10212025-03-25T21:57:04.476ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10222025-03-25T21:57:04.476ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232025-03-25T21:57:04.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10242025-03-25T21:57:04.487ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
10252025-03-25T21:57:04.487ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
10262025-03-25T21:57:04.487ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
10272025-03-25T21:57:04.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10282025-03-25T21:57:04.499ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10292025-03-25T21:57:04.532ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10302025-03-25T21:57:04.532ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10312025-03-25T21:57:04.532ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10322025-03-25T21:57:04.563ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 194, 139]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
10332025-03-25T21:57:04.563ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = boundary_ntp
10342025-03-25T21:57:04.564ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
10352025-03-25T21:57:04.564ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
10362025-03-25T21:57:04.564ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
10372025-03-25T21:57:04.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10382025-03-25T21:57:04.589ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d file = illumos-utils/src/zone.rs:356
10392025-03-25T21:57:04.608ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d file = illumos-utils/src/zone.rs:394
10402025-03-25T21:57:05.255ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10412025-03-25T21:57:05.255ZINFOSledAgent (ServiceManager): Booting oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10422025-03-25T21:57:05.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 73.04655ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10432025-03-25T21:57:05.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 64.315678ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10442025-03-25T21:57:05.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 195.717472ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10452025-03-25T21:57:05.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 223.155326ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10462025-03-25T21:57:05.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 1.093745682s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10472025-03-25T21:57:07.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 541.413213ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10482025-03-25T21:57:07.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 511.726623ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10492025-03-25T21:57:07.864ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10502025-03-25T21:57:07.865ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10512025-03-25T21:57:08.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 847.862292ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10522025-03-25T21:57:08.213ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10532025-03-25T21:57:08.214ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10542025-03-25T21:57:09.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 993.367379ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10552025-03-25T21:57:10.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d") failed: Property not found. retry in 933.349155ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10562025-03-25T21:57:10.999ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d
10572025-03-25T21:57:10.999ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10582025-03-25T21:57:11.000ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10592025-03-25T21:57:11.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6576629 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54640 req_id = b838082c-cffb-4e68-939f-bc4e277fa4dc response_code = 200 uri = /omicron-config
10602025-03-25T21:57:11.002ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:683
10612025-03-25T21:57:11.032ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10622025-03-25T21:57:11.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36581
10632025-03-25T21:57:11.041ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10642025-03-25T21:57:11.041ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8713 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36581 req_id = a9e1b7b7-94fa-4a86-a67e-ade00c73f644 response_code = 500 uri = /timesync
10652025-03-25T21:57:11.043ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10662025-03-25T21:57:11.177ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10672025-03-25T21:57:11.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39784
10682025-03-25T21:57:15.187ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4034
10692025-03-25T21:57:15.187ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008991 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39784 req_id = a1963984-6413-44da-bf4a-9b2b6593c6b0 response_code = 500 uri = /timesync
10702025-03-25T21:57:15.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10712025-03-25T21:57:15.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10722025-03-25T21:57:15.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
10732025-03-25T21:57:15.190ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10742025-03-25T21:57:15.293ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10752025-03-25T21:57:15.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51480
10762025-03-25T21:57:15.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51480 req_id = 7fc3074e-58b3-4762-bdce-38c64825b1e8 response_code = 200 uri = /timesync
10772025-03-25T21:57:15.304ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10782025-03-25T21:57:15.304ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10792025-03-25T21:57:15.537ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10802025-03-25T21:57:15.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48143
10812025-03-25T21:57:15.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7624 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48143 req_id = 19552b81-31da-4b97-9f9f-b97dfd4655ab response_code = 200 uri = /timesync
10822025-03-25T21:57:15.546ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10832025-03-25T21:57:15.546ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10842025-03-25T21:57:15.775ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10852025-03-25T21:57:15.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44250
10862025-03-25T21:57:15.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44250 req_id = aa2f106e-0ba2-4e6d-b43d-cc04affcefed response_code = 200 uri = /timesync
10872025-03-25T21:57:15.784ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10882025-03-25T21:57:15.784ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10892025-03-25T21:57:15.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10902025-03-25T21:57:15.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50807
10912025-03-25T21:57:15.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50807 req_id = 8ee2789e-4f53-4fbb-9220-20d0669fef31 response_code = 200 uri = /timesync
10922025-03-25T21:57:15.989ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10932025-03-25T21:57:15.989ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10942025-03-25T21:57:16.235ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
10952025-03-25T21:57:16.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42318
10962025-03-25T21:57:16.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42318 req_id = 22c474f1-8038-4ee0-85ec-fa4cb91f6302 response_code = 200 uri = /timesync
10972025-03-25T21:57:16.246ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
10982025-03-25T21:57:16.246ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
10992025-03-25T21:57:16.706ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11002025-03-25T21:57:16.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51082
11012025-03-25T21:57:16.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51082 req_id = 9921e9b2-9ddc-47fc-80c5-2fe9106d2e41 response_code = 200 uri = /timesync
11022025-03-25T21:57:16.718ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
11032025-03-25T21:57:16.718ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11042025-03-25T21:57:17.280ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11052025-03-25T21:57:17.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59571
11062025-03-25T21:57:17.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59571 req_id = 62d6f10e-b9b6-46d1-96fe-2ad343482344 response_code = 200 uri = /timesync
11072025-03-25T21:57:17.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
11082025-03-25T21:57:17.290ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11092025-03-25T21:57:18.242ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11102025-03-25T21:57:18.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51125
11112025-03-25T21:57:18.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51125 req_id = 2eb68e2e-2ea6-42b2-bedf-dcb3a2f2ace4 response_code = 200 uri = /timesync
11122025-03-25T21:57:18.251ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
11132025-03-25T21:57:18.251ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11142025-03-25T21:57:18.634ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11152025-03-25T21:57:18.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44945
11162025-03-25T21:57:18.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44945 req_id = 793bdaaf-2969-40ce-a1af-f0c424accd75 response_code = 200 uri = /timesync
11172025-03-25T21:57:18.644ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:691
11182025-03-25T21:57:18.644ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11192025-03-25T21:57:18.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11202025-03-25T21:57:18.734ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11212025-03-25T21:57:19.108ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11222025-03-25T21:57:19.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55659
11232025-03-25T21:57:19.109ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11242025-03-25T21:57:19.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11252025-03-25T21:57:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8503 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55659 req_id = eb927a5e-d54a-4710-889b-8cf10d370693 response_code = 200 uri = /timesync
11262025-03-25T21:57:19.121ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.255622119 } file = sled-agent/src/rack_setup/service.rs:691
11272025-03-25T21:57:19.121ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11282025-03-25T21:57:20.173ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11292025-03-25T21:57:20.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52295
11302025-03-25T21:57:20.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52295 req_id = e03771aa-1b5f-4ed3-b93b-6178c83428c7 response_code = 200 uri = /timesync
11312025-03-25T21:57:20.184ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.253836453 } file = sled-agent/src/rack_setup/service.rs:691
11322025-03-25T21:57:20.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11332025-03-25T21:57:21.282ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11342025-03-25T21:57:21.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62850
11352025-03-25T21:57:21.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62850 req_id = 202be035-54c0-4b12-8765-16e743260318 response_code = 200 uri = /timesync
11362025-03-25T21:57:21.292ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.250747472 } file = sled-agent/src/rack_setup/service.rs:691
11372025-03-25T21:57:21.292ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11382025-03-25T21:57:21.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11392025-03-25T21:57:21.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11402025-03-25T21:57:22.525ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11412025-03-25T21:57:22.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63204
11422025-03-25T21:57:22.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9073 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63204 req_id = d4731d11-7f6f-46e6-90a4-5ba88ee07992 response_code = 200 uri = /timesync
11432025-03-25T21:57:22.536ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1742939840.15951, correction: -0.247315809 } file = sled-agent/src/rack_setup/service.rs:691
11442025-03-25T21:57:22.536ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11452025-03-25T21:57:22.961ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 179.468402ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11462025-03-25T21:57:24.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11472025-03-25T21:57:24.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52270
11482025-03-25T21:57:24.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9471 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52270 req_id = 3aecfb4e-01e5-4471-8429-603072848f88 response_code = 200 uri = /timesync
11492025-03-25T21:57:24.388ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939842.54921, correction: -0.243527755 } file = sled-agent/src/rack_setup/service.rs:691
11502025-03-25T21:57:24.388ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11512025-03-25T21:57:26.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11522025-03-25T21:57:26.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37974
11532025-03-25T21:57:26.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11542025-03-25T21:57:26.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11552025-03-25T21:57:26.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11562025-03-25T21:57:26.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37974 req_id = aee69b6a-2b37-4dc5-8e51-af723da685cb response_code = 200 uri = /timesync
11572025-03-25T21:57:26.065ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939844.9757056, correction: -0.238884941 } file = sled-agent/src/rack_setup/service.rs:691
11582025-03-25T21:57:26.065ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11592025-03-25T21:57:28.185ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11602025-03-25T21:57:28.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47270
11612025-03-25T21:57:28.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47270 req_id = 71ac1815-b1b0-416c-9609-0cf54bc7bc88 response_code = 200 uri = /timesync
11622025-03-25T21:57:28.196ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939846.957753, correction: -0.23299022 } file = sled-agent/src/rack_setup/service.rs:691
11632025-03-25T21:57:28.196ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11642025-03-25T21:57:28.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11652025-03-25T21:57:28.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11662025-03-25T21:57:29.083ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11672025-03-25T21:57:29.086ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11682025-03-25T21:57:30.592ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11692025-03-25T21:57:30.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55795
11702025-03-25T21:57:30.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bc150923-cb46-43e4-ab5e-463b4b856bd5 response_code = 200 uri = /timesync
11712025-03-25T21:57:30.603ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939849.5815518, correction: -0.226530358 } file = sled-agent/src/rack_setup/service.rs:691
11722025-03-25T21:57:30.603ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11732025-03-25T21:57:31.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11742025-03-25T21:57:31.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11752025-03-25T21:57:33.415ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50968
11762025-03-25T21:57:33.415ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50968 req_id = b1092646-c5f5-44ce-b53a-49b5e2b8fc7b response_code = 200 uri = /baseboard
11772025-03-25T21:57:34.485ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11782025-03-25T21:57:34.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41505
11792025-03-25T21:57:34.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9511 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41505 req_id = 52dd18d2-5ffe-4d96-83b5-860f2b0cfe83 response_code = 200 uri = /timesync
11802025-03-25T21:57:34.498ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939852.8306334, correction: -0.215925798 } file = sled-agent/src/rack_setup/service.rs:691
11812025-03-25T21:57:34.498ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11822025-03-25T21:57:36.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11832025-03-25T21:57:36.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11842025-03-25T21:57:36.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11852025-03-25T21:57:36.743ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
11862025-03-25T21:57:36.745ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
11872025-03-25T21:57:36.746ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
11882025-03-25T21:57:36.746ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
11892025-03-25T21:57:38.133ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 494.420611ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11902025-03-25T21:57:38.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
11912025-03-25T21:57:38.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59515
11922025-03-25T21:57:38.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9070 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59515 req_id = c512c727-bebc-4a29-bce5-7ed5cc752c54 response_code = 200 uri = /timesync
11932025-03-25T21:57:38.365ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939857.4418442, correction: -0.205405846 } file = sled-agent/src/rack_setup/service.rs:691
11942025-03-25T21:57:38.365ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
11952025-03-25T21:57:38.686ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11962025-03-25T21:57:38.686ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11972025-03-25T21:57:39.057ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11982025-03-25T21:57:39.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
11992025-03-25T21:57:41.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12002025-03-25T21:57:41.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12012025-03-25T21:57:43.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12022025-03-25T21:57:43.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59934
12032025-03-25T21:57:44.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59934 req_id = e7d9bd98-2acf-472f-9078-88aed4649bd2 response_code = 200 uri = /timesync
12042025-03-25T21:57:44.006ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1742939863.131868, correction: -0.190065727 } file = sled-agent/src/rack_setup/service.rs:691
12052025-03-25T21:57:44.006ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12062025-03-25T21:57:46.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12072025-03-25T21:57:46.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12082025-03-25T21:57:46.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12092025-03-25T21:57:48.660ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1482827261247926990 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12102025-03-25T21:57:48.661ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 330974410049423283 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12112025-03-25T21:57:48.767ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12122025-03-25T21:57:48.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44845
12132025-03-25T21:57:48.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8914 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44845 req_id = 7be28d6b-0742-441a-bbe0-cfaefbede61c response_code = 200 uri = /timesync
12142025-03-25T21:57:48.778ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939868.067707, correction: -0.175179347 } file = sled-agent/src/rack_setup/service.rs:691
12152025-03-25T21:57:48.778ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12162025-03-25T21:57:49.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12172025-03-25T21:57:49.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12182025-03-25T21:57:51.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12192025-03-25T21:57:51.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12202025-03-25T21:57:52.984ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12212025-03-25T21:57:52.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55664
12222025-03-25T21:57:52.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9078 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55664 req_id = d0f60207-e794-42a7-8acf-7fbf1eef0837 response_code = 200 uri = /timesync
12232025-03-25T21:57:52.995ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939872.5573063, correction: -0.163706213 } file = sled-agent/src/rack_setup/service.rs:691
12242025-03-25T21:57:52.995ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12252025-03-25T21:57:53.619ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 540.714331ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12262025-03-25T21:57:55.983ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12272025-03-25T21:57:55.983ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12282025-03-25T21:57:55.983ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12292025-03-25T21:57:59.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12302025-03-25T21:57:59.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12312025-03-25T21:58:00.400ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12322025-03-25T21:58:00.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41343
12332025-03-25T21:58:00.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41343 req_id = 847d9320-0629-4068-ad24-7de7375ec4e7 response_code = 200 uri = /timesync
12342025-03-25T21:58:00.412ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939879.054952, correction: -0.14357844 } file = sled-agent/src/rack_setup/service.rs:691
12352025-03-25T21:58:00.412ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12362025-03-25T21:58:01.761ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12372025-03-25T21:58:01.761ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12382025-03-25T21:58:03.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48929
12392025-03-25T21:58:03.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48929 req_id = e6cdac1a-40b4-4ad2-89fb-2ea4483d814c response_code = 200 uri = /baseboard
12402025-03-25T21:58:05.958ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6882717206485205232 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12412025-03-25T21:58:05.958ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9765267888291091426 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12422025-03-25T21:58:05.958ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6231730758868097817 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12432025-03-25T21:58:08.981ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12442025-03-25T21:58:08.982ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12452025-03-25T21:58:09.152ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.760049991s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12462025-03-25T21:58:11.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12472025-03-25T21:58:11.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42465
12482025-03-25T21:58:11.761ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11527927056063748472 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12492025-03-25T21:58:11.763ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 967006371811566174 reason = Duration(60s) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12502025-03-25T21:58:11.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 0b726697-18b9-46d4-ae88-c5a5b4a303ff response_code = 200 uri = /timesync
12512025-03-25T21:58:11.768ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939889.4470887, correction: -0.112738788 } file = sled-agent/src/rack_setup/service.rs:691
12522025-03-25T21:58:11.768ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12532025-03-25T21:58:17.066ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12542025-03-25T21:58:17.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51789
12552025-03-25T21:58:17.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51789 req_id = 0e9d3c9a-32f0-4e66-af0c-ac8cf9a0d585 response_code = 200 uri = /timesync
12562025-03-25T21:58:17.077ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939896.449338, correction: -0.098310918 } file = sled-agent/src/rack_setup/service.rs:691
12572025-03-25T21:58:17.077ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12582025-03-25T21:58:18.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12592025-03-25T21:58:18.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12602025-03-25T21:58:25.902ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.620970464s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12612025-03-25T21:58:26.059ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12622025-03-25T21:58:26.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53806
12632025-03-25T21:58:26.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53806 req_id = 50b11a3c-9322-408d-b2aa-f05186031b89 response_code = 200 uri = /timesync
12642025-03-25T21:58:26.071ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939904.711036, correction: -0.073869057 } file = sled-agent/src/rack_setup/service.rs:691
12652025-03-25T21:58:26.071ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:713
12662025-03-25T21:58:28.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10877910902265131689 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12672025-03-25T21:58:28.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16164655193565630044 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12682025-03-25T21:58:33.319ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38037
12692025-03-25T21:58:33.319ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38037 req_id = 0ef2077c-d071-4cc9-9122-8888b97bde11 response_code = 200 uri = /baseboard
12702025-03-25T21:58:36.581ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
12712025-03-25T21:58:36.582ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
12722025-03-25T21:58:36.584ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
12732025-03-25T21:58:36.584ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
12742025-03-25T21:58:37.461ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:663
12752025-03-25T21:58:37.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52406
12762025-03-25T21:58:37.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22957 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52406 req_id = 083c044d-8ddc-4f96-8249-2ab728f6a281 response_code = 200 uri = /timesync
12772025-03-25T21:58:37.486ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:57:48.661434634Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 330974410049423283 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12782025-03-25T21:58:37.486ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:58:11.761057103Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11527927056063748472 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12792025-03-25T21:58:37.486ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:58:11.763030647Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 967006371811566174 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12802025-03-25T21:58:37.486ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:58:05.958876555Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6231730758868097817 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12812025-03-25T21:58:37.487ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:58:05.958303085Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6882717206485205232 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12822025-03-25T21:58:37.487ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:57:48.660888254Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1482827261247926990 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12832025-03-25T21:58:37.487ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-25T21:58:05.958690322Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9765267888291091426 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12842025-03-25T21:58:37.487ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1742939911.9681046, correction: -0.042917434 } file = sled-agent/src/rack_setup/service.rs:691
12852025-03-25T21:58:37.487ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1327
12862025-03-25T21:58:37.517ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(4), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(4), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5533f428-2028-4269-b7b1-f15912c01133 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 66b022b6-2e12-413e-b4b7-56c4ad5bdd77 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: f337d25b-c67a-4a32-89e1-e187aea97ed9 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b150a584-3fda-41cb-98cf-f12598e3f20c, kind: Service { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d }, name: Name("ntp-834363ac-29cb-47d1-b5b5-9a2185c31d2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 139])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1282c308-86f4-45af-83f6-e207940ec1e1 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37875737-ccc9-43b9-8802-3cf83b270005 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4b233606-88b8-4e0c-8191-085d0d67b4a8 (service), filesystem_pool: Some(ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 59ebfca4-ae28-4374-a6e0-362f5203dde3 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7ce4f174-3ae2-4592-a893-1b55ff404e61 (service), filesystem_pool: Some(ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } } }, image_source: InstallDataset }] }
12872025-03-25T21:58:37.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44807
12882025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
12892025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(4), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
12902025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
12912025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
12922025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
12932025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
12942025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
12952025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
12962025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
12972025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
12982025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
12992025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
13002025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
13012025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
13022025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
13032025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
13042025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
13052025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
13062025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
13072025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
13082025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
13092025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
13102025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
13112025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
13122025-03-25T21:58:37.518ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
13132025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
13142025-03-25T21:58:37.518ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(4), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
13152025-03-25T21:58:37.518ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
13162025-03-25T21:58:37.518ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
13172025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
13182025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13192025-03-25T21:58:37.518ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13202025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(4) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13212025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13222025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13232025-03-25T21:58:37.518ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(4) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13242025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13252025-03-25T21:58:37.518ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(4)
13262025-03-25T21:58:37.518ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13272025-03-25T21:58:37.518ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
13282025-03-25T21:58:37.519ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(4), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
13292025-03-25T21:58:37.519ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
13302025-03-25T21:58:37.519ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
13312025-03-25T21:58:37.519ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
13322025-03-25T21:58:37.519ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(3) request = datasets_ensure requested_generation = Generation(4)
13332025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13342025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13352025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13362025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13372025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13382025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13392025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13402025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13412025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13422025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13432025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13442025-03-25T21:58:37.548ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13452025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13462025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13472025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13482025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13492025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
13502025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13512025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13522025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13532025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13542025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13552025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13562025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13572025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13582025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13592025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13602025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13612025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13622025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13632025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13642025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13652025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13662025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13672025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13682025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13692025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13702025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13712025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13722025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13732025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13742025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13752025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13762025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13772025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13782025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13792025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13802025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13812025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13822025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13832025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13842025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13852025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13862025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13872025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13882025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13892025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13902025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13912025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13922025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13932025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13942025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
13952025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13962025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
13972025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
13982025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
13992025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14002025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14012025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14022025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14032025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14042025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14052025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14062025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14072025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14082025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14092025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14102025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14112025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14122025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14132025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14142025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14152025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14162025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14172025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14182025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14192025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14202025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14212025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14222025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14232025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14242025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14252025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14262025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14272025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14282025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14292025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14302025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14312025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14322025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14332025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14342025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14352025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14362025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14372025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14382025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14392025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14402025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14412025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14422025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14432025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14442025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14452025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14462025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14472025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14482025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14492025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14502025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14512025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14522025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14532025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14542025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14552025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14562025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14572025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14582025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14592025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14602025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14612025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14622025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14632025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14642025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14652025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14662025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14672025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14682025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14692025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14702025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14712025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14722025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14732025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14742025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14752025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14762025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14772025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14782025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
14792025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14802025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14812025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14822025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14832025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14842025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14852025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14862025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14872025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14882025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14892025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14902025-03-25T21:58:37.549ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14912025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14922025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14932025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14942025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14952025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14962025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
14972025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
14982025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
14992025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15002025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15012025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15022025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15032025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15042025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15052025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15062025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15072025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15082025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15092025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15102025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15112025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15122025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15132025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15142025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15152025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15162025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15172025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15182025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15192025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15202025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15212025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15222025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15232025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15242025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15252025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15262025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15272025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15282025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
15292025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
15302025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
15312025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
15322025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
15332025-03-25T21:58:37.550ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
15342025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15352025-03-25T21:58:37.550ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }
15362025-03-25T21:58:37.560ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15372025-03-25T21:58:37.560ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
15382025-03-25T21:58:37.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
15392025-03-25T21:58:37.572ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }
15402025-03-25T21:58:37.581ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15412025-03-25T21:58:37.581ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15422025-03-25T21:58:37.591ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15432025-03-25T21:58:37.591ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, responder: ... }
15442025-03-25T21:58:37.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15452025-03-25T21:58:37.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, responder: ... }
15462025-03-25T21:58:37.610ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15472025-03-25T21:58:37.610ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15482025-03-25T21:58:37.619ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
15492025-03-25T21:58:37.619ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
15502025-03-25T21:58:37.628ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15512025-03-25T21:58:37.628ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
15522025-03-25T21:58:37.629ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
15532025-03-25T21:58:37.629ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
15542025-03-25T21:58:37.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15552025-03-25T21:58:37.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15562025-03-25T21:58:37.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15572025-03-25T21:58:37.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15582025-03-25T21:58:37.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15592025-03-25T21:58:37.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15602025-03-25T21:58:37.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005 file = illumos-utils/src/zone.rs:356
15612025-03-25T21:58:37.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3 file = illumos-utils/src/zone.rs:356
15622025-03-25T21:58:37.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8 file = illumos-utils/src/zone.rs:356
15632025-03-25T21:58:37.813ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 file = illumos-utils/src/zone.rs:356
15642025-03-25T21:58:37.818ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61 file = illumos-utils/src/zone.rs:356
15652025-03-25T21:58:37.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005 file = illumos-utils/src/zone.rs:394
15662025-03-25T21:58:37.828ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3 file = illumos-utils/src/zone.rs:394
15672025-03-25T21:58:37.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8 file = illumos-utils/src/zone.rs:394
15682025-03-25T21:58:37.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 file = illumos-utils/src/zone.rs:394
15692025-03-25T21:58:37.842ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61 file = illumos-utils/src/zone.rs:394
15702025-03-25T21:58:41.672ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='37875737-ccc9-43b9-8802-3cf83b270005'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15712025-03-25T21:58:41.672ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
15722025-03-25T21:58:41.681ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4b233606-88b8-4e0c-8191-085d0d67b4a8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15732025-03-25T21:58:41.681ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
15742025-03-25T21:58:41.686ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1282c308-86f4-45af-83f6-e207940ec1e1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15752025-03-25T21:58:41.687ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
15762025-03-25T21:58:41.707ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='59ebfca4-ae28-4374-a6e0-362f5203dde3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15772025-03-25T21:58:41.708ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
15782025-03-25T21:58:41.775ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7ce4f174-3ae2-4592-a893-1b55ff404e61'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15792025-03-25T21:58:41.776ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
15802025-03-25T21:58:41.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 40.560143ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
15812025-03-25T21:58:41.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 50.529668ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
15822025-03-25T21:58:41.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 34.009246ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
15832025-03-25T21:58:41.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 33.089835ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
15842025-03-25T21:58:41.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 98.529701ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
15852025-03-25T21:58:41.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 113.635509ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
15862025-03-25T21:58:41.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 142.908962ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
15872025-03-25T21:58:41.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 69.950489ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
15882025-03-25T21:58:41.957ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 64.602396ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
15892025-03-25T21:58:42.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 112.906557ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
15902025-03-25T21:58:42.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 139.461097ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
15912025-03-25T21:58:42.044ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 157.874144ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
15922025-03-25T21:58:42.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 51.947379ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
15932025-03-25T21:58:42.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 161.29142ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
15942025-03-25T21:58:42.139ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 193.383312ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
15952025-03-25T21:58:42.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 213.640016ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
15962025-03-25T21:58:42.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 405.527579ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
15972025-03-25T21:58:42.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 313.023398ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
15982025-03-25T21:58:42.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 568.588987ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
15992025-03-25T21:58:42.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 531.092332ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16002025-03-25T21:58:42.376ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 877.800642ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16012025-03-25T21:58:42.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 950.604986ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16022025-03-25T21:58:42.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 495.735664ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16032025-03-25T21:58:42.840ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 1.139486364s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16042025-03-25T21:58:42.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 697.668368ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16052025-03-25T21:58:43.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.499054725s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16062025-03-25T21:58:43.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 820.324198ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16072025-03-25T21:58:43.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 968.969102ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16082025-03-25T21:58:43.518ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.733667118s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
16092025-03-25T21:58:43.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 972.651037ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16102025-03-25T21:58:43.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 1.103790093s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16112025-03-25T21:58:44.088ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 1.058626539s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16122025-03-25T21:58:44.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 1.26627683s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16132025-03-25T21:58:44.566ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 1.373020273s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16142025-03-25T21:58:44.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 940.918935ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16152025-03-25T21:58:45.096ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 603.089008ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16162025-03-25T21:58:45.151ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 1.088539909s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16172025-03-25T21:58:45.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.390629611s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16182025-03-25T21:58:45.705ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 979.594535ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16192025-03-25T21:58:45.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 999.531191ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16202025-03-25T21:58:45.945ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 1.35439639s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16212025-03-25T21:58:46.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 1.166287262s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16222025-03-25T21:58:46.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 1.001234098s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16232025-03-25T21:58:46.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 904.160976ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16242025-03-25T21:58:46.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.327330419s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16252025-03-25T21:58:47.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 851.404779ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16262025-03-25T21:58:47.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 1.069838432s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16272025-03-25T21:58:47.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 845.346496ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16282025-03-25T21:58:47.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 1.451483038s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16292025-03-25T21:58:48.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 1.173982044s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16302025-03-25T21:58:48.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.032056726s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16312025-03-25T21:58:48.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 751.747573ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16322025-03-25T21:58:48.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 1.033027168s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16332025-03-25T21:58:49.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 515.534467ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16342025-03-25T21:58:49.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 701.158435ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16352025-03-25T21:58:49.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.186523854s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16362025-03-25T21:58:49.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 828.806293ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16372025-03-25T21:58:49.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 581.846805ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16382025-03-25T21:58:49.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 974.638963ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16392025-03-25T21:58:49.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 730.012966ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16402025-03-25T21:58:50.161ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 505.621145ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16412025-03-25T21:58:50.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 1.137567094s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16422025-03-25T21:58:50.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 568.712304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16432025-03-25T21:58:50.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 1.262519753s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16442025-03-25T21:58:50.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 658.667029ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16452025-03-25T21:58:50.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 1.33683247s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16462025-03-25T21:58:51.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.450289352s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16472025-03-25T21:58:51.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 1.195073821s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16482025-03-25T21:58:51.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 623.291356ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16492025-03-25T21:58:51.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 771.444629ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16502025-03-25T21:58:51.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 1.40603254s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16512025-03-25T21:58:52.044ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 549.999567ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16522025-03-25T21:58:52.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 536.42475ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16532025-03-25T21:58:52.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3") failed: Property not found. retry in 1.432484679s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16542025-03-25T21:58:52.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 822.20302ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16552025-03-25T21:58:52.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 717.298745ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16562025-03-25T21:58:53.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 636.638897ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16572025-03-25T21:58:53.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 655.971623ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16582025-03-25T21:58:53.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 559.611415ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16592025-03-25T21:58:53.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005") failed: Property not found. retry in 966.34518ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16602025-03-25T21:58:53.714ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61") failed: Property not found. retry in 510.25145ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16612025-03-25T21:58:53.997ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8") failed: Property not found. retry in 551.045899ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16622025-03-25T21:58:54.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1") failed: Property not found. retry in 616.867721ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16632025-03-25T21:58:54.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005
16642025-03-25T21:58:54.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3
16652025-03-25T21:58:54.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8
16662025-03-25T21:58:54.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1
16672025-03-25T21:58:54.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61
16682025-03-25T21:58:54.684ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
16692025-03-25T21:58:54.684ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
16702025-03-25T21:58:54.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17212216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44807 req_id = aa963f93-a590-4507-bf3f-2956cb9b75b6 response_code = 200 uri = /omicron-config
16712025-03-25T21:58:54.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40129
16722025-03-25T21:58:54.750ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29715 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = f75fa80b-6afe-48de-afcc-c0c478d802d4 response_code = 500 uri = /cockroachdb
16732025-03-25T21:58:54.750ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f75fa80b-6afe-48de-afcc-c0c478d802d4", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f75fa80b-6afe-48de-afcc-c0c478d802d4" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 73.22671ms
16742025-03-25T21:58:54.849ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 24953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 62381873-4a32-49fd-816e-472d52ae8d7c response_code = 500 uri = /cockroachdb
16752025-03-25T21:58:54.849ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "62381873-4a32-49fd-816e-472d52ae8d7c", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "62381873-4a32-49fd-816e-472d52ae8d7c" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 120.391903ms
16762025-03-25T21:58:54.996ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 2855f4bb-1bfa-4cd4-904f-9a002ad5a271 response_code = 500 uri = /cockroachdb
16772025-03-25T21:58:54.996ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2855f4bb-1bfa-4cd4-904f-9a002ad5a271", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2855f4bb-1bfa-4cd4-904f-9a002ad5a271" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 213.678064ms
16782025-03-25T21:58:55.241ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 15661299-8798-4cf6-add6-40a585c741c7 response_code = 500 uri = /cockroachdb
16792025-03-25T21:58:55.241ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "15661299-8798-4cf6-add6-40a585c741c7", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "15661299-8798-4cf6-add6-40a585c741c7" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 129.573347ms
16802025-03-25T21:58:55.401ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = d4b10b0e-1d84-4b4a-87cc-562c5ebc7396 response_code = 500 uri = /cockroachdb
16812025-03-25T21:58:55.401ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d4b10b0e-1d84-4b4a-87cc-562c5ebc7396", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d4b10b0e-1d84-4b4a-87cc-562c5ebc7396" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 191.92335ms
16822025-03-25T21:58:55.620ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = e5441091-116a-42e5-8653-b8de19ce5721 response_code = 500 uri = /cockroachdb
16832025-03-25T21:58:55.621ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e5441091-116a-42e5-8653-b8de19ce5721", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e5441091-116a-42e5-8653-b8de19ce5721" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 298.361119ms
16842025-03-25T21:58:55.947ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 491b0856-60da-45fc-a5c9-7909542c1ced response_code = 500 uri = /cockroachdb
16852025-03-25T21:58:55.948ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "491b0856-60da-45fc-a5c9-7909542c1ced", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "491b0856-60da-45fc-a5c9-7909542c1ced" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 265.226386ms
16862025-03-25T21:58:56.240ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = d9bb5f4f-f5f5-47a0-b110-c906299c8344 response_code = 500 uri = /cockroachdb
16872025-03-25T21:58:56.241ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d9bb5f4f-f5f5-47a0-b110-c906299c8344", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d9bb5f4f-f5f5-47a0-b110-c906299c8344" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 390.286291ms
16882025-03-25T21:58:56.660ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 051a2dda-ee09-47ff-9f63-1d65e90cb198 response_code = 500 uri = /cockroachdb
16892025-03-25T21:58:56.660ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "051a2dda-ee09-47ff-9f63-1d65e90cb198", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "051a2dda-ee09-47ff-9f63-1d65e90cb198" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 406.583592ms
16902025-03-25T21:58:57.093ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26141 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = e0c3b512-fecb-4f9c-9251-68a6b589510a response_code = 500 uri = /cockroachdb
16912025-03-25T21:58:57.094ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e0c3b512-fecb-4f9c-9251-68a6b589510a", "content-length": "124", "date": "Tue, 25 Mar 2025 21:58:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e0c3b512-fecb-4f9c-9251-68a6b589510a" } file = sled-agent/src/rack_setup/service.rs:1090 retry_after = 440.747618ms
16922025-03-25T21:58:57.568ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3877
16932025-03-25T21:59:11.850ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3895
16942025-03-25T21:59:32.916ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3918
16952025-03-25T21:59:32.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35378896 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40129 req_id = 526c85aa-439e-4bb2-b181-ab98248e09ff response_code = 204 uri = /cockroachdb
16962025-03-25T21:59:32.934ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 21.894967275s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
16972025-03-25T21:59:32.975ZINFOSledAgent (RSS): attempting to set sled's config datasets = DatasetsConfig { generation: Generation(5), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } disks = OmicronPhysicalDisksConfig { generation: Generation(5), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:370 sled_address = [fd00:1122:3344:101::1]:12345 zones = OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5533f428-2028-4269-b7b1-f15912c01133 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 66b022b6-2e12-413e-b4b7-56c4ad5bdd77 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: f337d25b-c67a-4a32-89e1-e187aea97ed9 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b150a584-3fda-41cb-98cf-f12598e3f20c, kind: Service { id: 834363ac-29cb-47d1-b5b5-9a2185c31d2d }, name: Name("ntp-834363ac-29cb-47d1-b5b5-9a2185c31d2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 139])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1282c308-86f4-45af-83f6-e207940ec1e1 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37875737-ccc9-43b9-8802-3cf83b270005 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4b233606-88b8-4e0c-8191-085d0d67b4a8 (service), filesystem_pool: Some(ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 59ebfca4-ae28-4374-a6e0-362f5203dde3 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7ce4f174-3ae2-4592-a893-1b55ff404e61 (service), filesystem_pool: Some(ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 128b0bf2-5487-4645-8c6f-90a651cbc65d (service), filesystem_pool: Some(ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 12db6227-4fe9-4ab3-8153-dae270d07387 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 203169ef-9fe5-4a34-b981-5db138d44110 (service), filesystem_pool: Some(ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 5279fc0d-6158-4549-b943-9e54e698576a (service), filesystem_pool: Some(ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 76a4636e-6952-47a1-8a71-cd6816e00858 (service), filesystem_pool: Some(ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308 (service), filesystem_pool: Some(ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8d8fe429-0836-4c1c-830d-f6500bc959cf (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9111bbf6-8db9-46b2-8b3d-67ae35f2b931 (service), filesystem_pool: Some(ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: a18f8359-ed3e-42ff-ad0c-f9bb63497f28 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ae94c19c-730a-47e6-960b-263c29dea9ca (service), filesystem_pool: Some(ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: d0f52952-f214-42ac-b892-8e4bfacbc8da (service), filesystem_pool: Some(ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: d96b5518-7771-4a6a-a482-8a89187c6481 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 (service), filesystem_pool: Some(ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: ec539d60-a406-4fe9-a658-fbc8b3fb545b (service), filesystem_pool: Some(ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: f41042a4-ad13-46d6-859e-bff1b46ae766 (service), filesystem_pool: Some(ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f44205a7-6f8b-400e-be5b-2df60f5cb751 (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c (service), filesystem_pool: Some(ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }] }
16982025-03-25T21:59:32.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56768
16992025-03-25T21:59:32.980ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17002025-03-25T21:59:32.981ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(5), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 07de9f50-e737-415f-a2aa-a4276bf89360 (physical_disk), pool_id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1465ae48-764b-4240-8b79-56ba467169f5 (physical_disk), pool_id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 91b6e70b-42e3-4199-a9bd-16f1259ea1b7 (physical_disk), pool_id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aebd4b57-b223-4312-a37b-83cdab6676c5 (physical_disk), pool_id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b79b1519-38f7-4e7c-9850-07e3b51749df (physical_disk), pool_id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: bbddeee9-03f7-4760-ae00-f3b0ac4207f2 (physical_disk), pool_id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c00b2700-5de4-470d-abeb-fcc0e83d2b8a (physical_disk), pool_id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7a794d4-7973-4af7-bc0f-a62cbdd236f4 (physical_disk), pool_id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f2638abb-57ce-49ce-99b4-fdea40ee2e2e (physical_disk), pool_id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
17012025-03-25T21:59:32.981ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
17022025-03-25T21:59:32.982ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-physical-disks.json file = common/src/ledger.rs:175 request = omicron_physical_disks_ensure
17032025-03-25T21:59:32.982ZINFOSledAgent (StorageManager): Comparing 'requested disks' to ledger on internal storage file = sled-storage/src/manager.rs:1262 request = omicron_physical_disks_ensure
17042025-03-25T21:59:32.982ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:1297 request = omicron_physical_disks_ensure
17052025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:308
17062025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:364
17072025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:412
17082025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:364
17092025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:412
17102025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:364
17112025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:412
17122025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:364
17132025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:412
17142025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:364
17152025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:412
17162025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:364
17172025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:412
17182025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:364
17192025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:412
17202025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:364
17212025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:412
17222025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:364
17232025-03-25T21:59:32.982ZINFOSledAgent (StorageResources): Disk already managed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:412
17242025-03-25T21:59:32.982ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
17252025-03-25T21:59:32.983ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(5), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f2cdc-0e38-40dd-8afe-efcd7214bccc (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7067d582-a933-4db2-a989-84ac7b8cd012 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
17262025-03-25T21:59:32.983ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
17272025-03-25T21:59:32.983ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
17282025-03-25T21:59:32.983ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
17292025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17302025-03-25T21:59:32.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17312025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(5) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17322025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17332025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17342025-03-25T21:59:32.984ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(5) sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17352025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17362025-03-25T21:59:32.984ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(5)
17372025-03-25T21:59:32.984ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17382025-03-25T21:59:32.984ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
17392025-03-25T21:59:32.984ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(5), datasets: {04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset): DatasetConfig { id: 04ac33ed-5106-4328-bcb0-627ff20ad849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0de3085e-d560-452e-8f84-d4883972cbda (dataset): DatasetConfig { id: 0de3085e-d560-452e-8f84-d4883972cbda (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f51662d-d580-49b1-a35c-049630b1b9df (dataset): DatasetConfig { id: 0f51662d-d580-49b1-a35c-049630b1b9df (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37875737-ccc9-43b9-8802-3cf83b270005" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 109962e9-aec4-4128-a39a-864e91374bd9 (dataset): DatasetConfig { id: 109962e9-aec4-4128-a39a-864e91374bd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset): DatasetConfig { id: 126a84dc-bc6b-4ac7-b594-8f0658afda69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset): DatasetConfig { id: 18837b35-3405-4d83-89ab-a9f1067471c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset): DatasetConfig { id: 26cb96ea-26a3-4e7b-a06f-d806bc16a126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset): DatasetConfig { id: 2daaf766-4f33-41d8-ad8f-dd1e1b11408e (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset): DatasetConfig { id: 2e3843e0-ce19-4819-b7e8-6a11b8e59ad7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset): DatasetConfig { id: 30deb5d0-cd7d-4a23-aebf-dd4bee6f8d86 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce4f174-3ae2-4592-a893-1b55ff404e61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ec745c-2135-497a-8b26-33074016e96b (dataset): DatasetConfig { id: 32ec745c-2135-497a-8b26-33074016e96b (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset): DatasetConfig { id: 339d87a6-659c-4c02-ba3d-5a0af093e2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset): DatasetConfig { id: 34017cd8-0375-4a79-bc1a-f1b5832e807a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3643586c-a983-47c8-9f67-51d34c713396 (dataset): DatasetConfig { id: 3643586c-a983-47c8-9f67-51d34c713396 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset): DatasetConfig { id: 4285bd6c-3ae0-4f9b-b6e3-a3c6f7e86041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset): DatasetConfig { id: 47ae7b3f-cd92-4787-bae8-ef072966f1ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset): DatasetConfig { id: 4b6d2151-ebd1-41a3-a940-97057d0425e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset): DatasetConfig { id: 4c54e194-fdaf-4c2d-a416-5580fd8b41a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset): DatasetConfig { id: 5138322f-6dad-44a5-9f60-9f5aea7df148 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_66b022b6-2e12-413e-b4b7-56c4ad5bdd77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56237c7c-2724-4354-841c-09fba4238af4 (dataset): DatasetConfig { id: 56237c7c-2724-4354-841c-09fba4238af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 615bbd66-a96a-4656-b26f-e5c368110062 (dataset): DatasetConfig { id: 615bbd66-a96a-4656-b26f-e5c368110062 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset): DatasetConfig { id: 65fd04d6-4e5e-42ee-8ab4-142c6648cded (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1282c308-86f4-45af-83f6-e207940ec1e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a0893d-ecba-44fb-914d-07093daee592 (dataset): DatasetConfig { id: 66a0893d-ecba-44fb-914d-07093daee592 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset): DatasetConfig { id: 685344f8-594c-43f9-8038-8b45caf8cb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset): DatasetConfig { id: 7b0c97a9-02d7-4bbb-a3d8-9e254cf4eb0e (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset): DatasetConfig { id: 7f66fb75-2321-4b1b-b985-a0b30da7d647 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset): DatasetConfig { id: 7f7544d9-8be3-4a35-9b84-20dbe147ec17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset): DatasetConfig { id: 82aa54d3-73ca-441f-b17c-5bbc47d4fefa (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset): DatasetConfig { id: 83743a7e-ccd9-4515-ba66-8c97ad8ba5eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a87a8e-32ef-4386-8098-d194ba056261 (dataset): DatasetConfig { id: 85a87a8e-32ef-4386-8098-d194ba056261 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset): DatasetConfig { id: 8847cdaf-5a0c-4eed-92d7-62bb02ab552a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset): DatasetConfig { id: 8ec24ac8-bf6c-47fe-90fe-d87f6828db3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90acdddb-344d-4363-96bf-30a534df6a4d (dataset): DatasetConfig { id: 90acdddb-344d-4363-96bf-30a534df6a4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset): DatasetConfig { id: 912f6fe8-318a-4126-b71e-39648b95ce9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59ebfca4-ae28-4374-a6e0-362f5203dde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset): DatasetConfig { id: 9d482dfd-6447-47e4-8ae7-b4238240e08c (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset): DatasetConfig { id: a0ca6818-4a7d-40d4-b563-5d56d3f09657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a485209b-d818-43bd-8ed4-40e3c8390043 (dataset): DatasetConfig { id: a485209b-d818-43bd-8ed4-40e3c8390043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7a2a41c-6108-499b-898a-6eed433d099a (dataset): DatasetConfig { id: a7a2a41c-6108-499b-898a-6eed433d099a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a975fd70-dc38-468a-98c8-b538d0a22005 (dataset): DatasetConfig { id: a975fd70-dc38-468a-98c8-b538d0a22005 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa358b50-517c-4c27-a4f2-1892f3912602 (dataset): DatasetConfig { id: aa358b50-517c-4c27-a4f2-1892f3912602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset): DatasetConfig { id: ad2da1ef-faa0-48c1-9ea3-be3b4951a326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4b233606-88b8-4e0c-8191-085d0d67b4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset): DatasetConfig { id: bbaa2f3e-75b7-4b41-b4e1-d09336e5c62c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be32fe94-31ba-419f-acce-86f2555f635d (dataset): DatasetConfig { id: be32fe94-31ba-419f-acce-86f2555f635d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset): DatasetConfig { id: c3ee2fd7-3e12-487c-8cd3-450e7af8bf7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447508e-a868-47f1-98a9-a5885662b1d1 (dataset): DatasetConfig { id: c447508e-a868-47f1-98a9-a5885662b1d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77d316a-c249-4dee-9f50-e0697247994b (dataset): DatasetConfig { id: c77d316a-c249-4dee-9f50-e0697247994b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset): DatasetConfig { id: c9c3f0c4-6d10-4998-8e41-3c21edde2d56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset): DatasetConfig { id: cca8c897-f94b-490b-ab94-e1bb408f9b66 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset): DatasetConfig { id: d10bd1dc-e592-43e6-a07b-926dc15b1e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset): DatasetConfig { id: d5ea0e3b-4dec-40ed-9f41-836fb525433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset): DatasetConfig { id: d678cfda-fb57-4089-acbe-9f528caf8e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f337d25b-c67a-4a32-89e1-e187aea97ed9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset): DatasetConfig { id: d68dd118-613f-426d-a2e8-0e0dfb30ca85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d987a229-1eda-4e68-970e-3f939c676c58 (dataset): DatasetConfig { id: d987a229-1eda-4e68-970e-3f939c676c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset): DatasetConfig { id: db5cae6c-0a2c-455c-859d-51ce0c0972c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset): DatasetConfig { id: e0264265-d97e-44db-bdfc-1eb008d5f710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset): DatasetConfig { id: e7ae0cf9-6f3d-46d9-b9b4-d754d43815ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5533f428-2028-4269-b7b1-f15912c01133" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset): DatasetConfig { id: e8c53ba3-2385-40c9-a405-695f0f166d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e91576bd-3a35-456f-b66f-a71bef245f66 (dataset): DatasetConfig { id: e91576bd-3a35-456f-b66f-a71bef245f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset): DatasetConfig { id: e97838f2-2bd1-4800-8da8-631dcd689a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset): DatasetConfig { id: ef77d277-9cb7-4ba6-8657-1629b2f349dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f382ded2-fdfb-46de-ad16-d1795227a712 (dataset): DatasetConfig { id: f382ded2-fdfb-46de-ad16-d1795227a712 (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset): DatasetConfig { id: f47b74f4-0f34-4ac9-b40b-ae304a39830c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset): DatasetConfig { id: f85f4d79-2222-4efc-99c8-649e59cd1729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_834363ac-29cb-47d1-b5b5-9a2185c31d2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset): DatasetConfig { id: f87e75c9-cae0-4c15-827b-6112c74f63a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset): DatasetConfig { id: f8d00239-0365-4d5b-b252-bc87e93f1aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset): DatasetConfig { id: fd10e2ea-734c-4efd-b820-013b6bd5b675 (dataset), name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
17402025-03-25T21:59:32.984ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
17412025-03-25T21:59:32.985ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-datasets.json file = common/src/ledger.rs:175 request = datasets_ensure
17422025-03-25T21:59:32.985ZINFOSledAgent (StorageManager): Comparing 'requested datasets' to ledger on internal storage file = sled-storage/src/manager.rs:866 request = datasets_ensure
17432025-03-25T21:59:32.985ZINFOSledAgent (StorageManager): Request looks newer than prior requests file = sled-storage/src/manager.rs:899 ledger_generation = Generation(4) request = datasets_ensure requested_generation = Generation(5)
17442025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17452025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17462025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17472025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17482025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17492025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17502025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17512025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17522025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17532025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17542025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17552025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17562025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17572025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17582025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17592025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17602025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
17612025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17622025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17632025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17642025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17652025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17662025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17672025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17682025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17692025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17702025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17712025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17722025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17732025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17742025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17752025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17762025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17772025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17782025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17792025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17802025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17812025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17822025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17832025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17842025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17852025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17862025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17872025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17882025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17892025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17902025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17912025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17922025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17932025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17942025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17952025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17962025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
17972025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
17982025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
17992025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18002025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18012025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18022025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18032025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18042025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18052025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18062025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18072025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18082025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18092025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18102025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18112025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18122025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18132025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18142025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18152025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18162025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18172025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18182025-03-25T21:59:33.021ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18192025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18202025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18212025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18222025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18232025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18242025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18252025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18262025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18272025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18282025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18292025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18302025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18312025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18322025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18332025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18342025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18352025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18362025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18372025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18382025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18392025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18402025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18412025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18422025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18432025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18442025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18452025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18462025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18472025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18482025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18492025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18502025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18512025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18522025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18532025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18542025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18552025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18562025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18572025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18582025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18592025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18602025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18612025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18622025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18632025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18642025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18652025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18662025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18672025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18682025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18692025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18702025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18712025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18722025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18732025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18742025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18752025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18762025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18772025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18782025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18792025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18802025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18812025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18822025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18832025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18842025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18852025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18862025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18872025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18882025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18892025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } request = datasets_ensure
18902025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18912025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18922025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18932025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18942025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18952025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18962025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
18972025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
18982025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
18992025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19002025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19012025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19022025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19032025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19042025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19052025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19062025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19072025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19082025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19092025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19102025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19112025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19122025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19132025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19142025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19152025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19162025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19172025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19182025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19192025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19202025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19212025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19222025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19232025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19242025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19252025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19262025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19272025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19282025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19292025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19302025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19312025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19322025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19332025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19342025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19352025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19362025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19372025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19382025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19392025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
19402025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Parsed old dataset properties file = sled-storage/src/manager.rs:1021 props = SharedDatasetConfig { compression: Off, quota: None, reservation: None } request = datasets_ensure
19412025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): No changes necessary, returning early file = sled-storage/src/manager.rs:1031 request = datasets_ensure
19422025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
19432025-03-25T21:59:33.022ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
19442025-03-25T21:59:33.023ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
19452025-03-25T21:59:33.023ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19462025-03-25T21:59:33.023ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: InternalDns }, responder: ... }
19472025-03-25T21:59:33.036ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19482025-03-25T21:59:33.036ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
19492025-03-25T21:59:33.047ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19502025-03-25T21:59:33.047ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: InternalDns }, responder: ... }
19512025-03-25T21:59:33.058ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19522025-03-25T21:59:33.058ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19532025-03-25T21:59:33.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19542025-03-25T21:59:33.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Cockroach }, responder: ... }
19552025-03-25T21:59:33.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19562025-03-25T21:59:33.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Cockroach }, responder: ... }
19572025-03-25T21:59:33.089ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19582025-03-25T21:59:33.089ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19592025-03-25T21:59:33.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
19602025-03-25T21:59:33.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
19612025-03-25T21:59:33.108ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19622025-03-25T21:59:33.108ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, kind: Crucible }, responder: ... }
19632025-03-25T21:59:33.117ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19642025-03-25T21:59:33.117ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, kind: Crucible }, responder: ... }
19652025-03-25T21:59:33.128ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19662025-03-25T21:59:33.128ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, kind: Crucible }, responder: ... }
19672025-03-25T21:59:33.138ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19682025-03-25T21:59:33.138ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
19692025-03-25T21:59:33.147ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19702025-03-25T21:59:33.147ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, kind: Crucible }, responder: ... }
19712025-03-25T21:59:33.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19722025-03-25T21:59:33.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
19732025-03-25T21:59:33.168ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19742025-03-25T21:59:33.168ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, kind: Crucible }, responder: ... }
19752025-03-25T21:59:33.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19762025-03-25T21:59:33.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, kind: Crucible }, responder: ... }
19772025-03-25T21:59:33.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19782025-03-25T21:59:33.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, kind: Crucible }, responder: ... }
19792025-03-25T21:59:33.195ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
19802025-03-25T21:59:33.195ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
19812025-03-25T21:59:33.205ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
19822025-03-25T21:59:33.205ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, kind: Crucible }, responder: ... }
19832025-03-25T21:59:33.214ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
19842025-03-25T21:59:33.214ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1481 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
19852025-03-25T21:59:33.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19862025-03-25T21:59:33.223ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
19872025-03-25T21:59:33.223ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
19882025-03-25T21:59:33.224ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:5000 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
19892025-03-25T21:59:33.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19902025-03-25T21:59:33.340ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
19912025-03-25T21:59:33.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19922025-03-25T21:59:33.353ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
19932025-03-25T21:59:33.389ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
19942025-03-25T21:59:33.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19952025-03-25T21:59:33.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19962025-03-25T21:59:33.402ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
19972025-03-25T21:59:33.402ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19982025-03-25T21:59:33.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19992025-03-25T21:59:33.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20002025-03-25T21:59:33.548ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
20012025-03-25T21:59:33.549ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20022025-03-25T21:59:33.549ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20032025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20042025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20052025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20062025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20072025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20082025-03-25T21:59:33.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20092025-03-25T21:59:33.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766 file = illumos-utils/src/zone.rs:356
20102025-03-25T21:59:33.603ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110 file = illumos-utils/src/zone.rs:356
20112025-03-25T21:59:33.609ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751 file = illumos-utils/src/zone.rs:356
20122025-03-25T21:59:33.615ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da file = illumos-utils/src/zone.rs:356
20132025-03-25T21:59:33.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a file = illumos-utils/src/zone.rs:356
20142025-03-25T21:59:33.626ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931 file = illumos-utils/src/zone.rs:356
20152025-03-25T21:59:33.789ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766 file = illumos-utils/src/zone.rs:394
20162025-03-25T21:59:33.795ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110 file = illumos-utils/src/zone.rs:394
20172025-03-25T21:59:33.800ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751 file = illumos-utils/src/zone.rs:394
20182025-03-25T21:59:33.804ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da file = illumos-utils/src/zone.rs:394
20192025-03-25T21:59:33.809ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a file = illumos-utils/src/zone.rs:394
20202025-03-25T21:59:33.814ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931 file = illumos-utils/src/zone.rs:394
20212025-03-25T21:59:33.820ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d file = illumos-utils/src/zone.rs:356
20222025-03-25T21:59:33.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481 file = illumos-utils/src/zone.rs:356
20232025-03-25T21:59:33.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf file = illumos-utils/src/zone.rs:356
20242025-03-25T21:59:33.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28 file = illumos-utils/src/zone.rs:356
20252025-03-25T21:59:33.842ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca file = illumos-utils/src/zone.rs:356
20262025-03-25T21:59:33.848ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308 file = illumos-utils/src/zone.rs:356
20272025-03-25T21:59:33.854ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b file = illumos-utils/src/zone.rs:356
20282025-03-25T21:59:33.861ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387 file = illumos-utils/src/zone.rs:356
20292025-03-25T21:59:33.926ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20302025-03-25T21:59:33.926ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d file = illumos-utils/src/zone.rs:394
20312025-03-25T21:59:33.935ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481 file = illumos-utils/src/zone.rs:394
20322025-03-25T21:59:33.942ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf file = illumos-utils/src/zone.rs:394
20332025-03-25T21:59:33.953ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28 file = illumos-utils/src/zone.rs:394
20342025-03-25T21:59:33.962ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca file = illumos-utils/src/zone.rs:394
20352025-03-25T21:59:33.969ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308 file = illumos-utils/src/zone.rs:394
20362025-03-25T21:59:33.977ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b file = illumos-utils/src/zone.rs:394
20372025-03-25T21:59:33.984ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387 file = illumos-utils/src/zone.rs:394
20382025-03-25T21:59:34.055ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20392025-03-25T21:59:34.176ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20402025-03-25T21:59:34.245ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20412025-03-25T21:59:34.252ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20422025-03-25T21:59:34.252ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20432025-03-25T21:59:34.312ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 238, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20442025-03-25T21:59:34.312ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20452025-03-25T21:59:34.374ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
20462025-03-25T21:59:34.376ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20472025-03-25T21:59:34.376ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20482025-03-25T21:59:34.430ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 175, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
20492025-03-25T21:59:34.430ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
20502025-03-25T21:59:34.432ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20512025-03-25T21:59:34.432ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20522025-03-25T21:59:34.487ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 135, 30]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
20532025-03-25T21:59:34.487ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
20542025-03-25T21:59:34.488ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20552025-03-25T21:59:34.489ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20562025-03-25T21:59:34.544ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 245, 244]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20572025-03-25T21:59:34.544ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20582025-03-25T21:59:34.545ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
20592025-03-25T21:59:34.545ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
20602025-03-25T21:59:34.548ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
20612025-03-25T21:59:34.548ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
20622025-03-25T21:59:34.605ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 216, 87]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
20632025-03-25T21:59:34.606ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
20642025-03-25T21:59:34.606ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
20652025-03-25T21:59:34.607ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
20662025-03-25T21:59:34.607ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
20672025-03-25T21:59:34.608ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20682025-03-25T21:59:34.662ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
20692025-03-25T21:59:34.662ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
20702025-03-25T21:59:34.662ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
20712025-03-25T21:59:34.666ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
20722025-03-25T21:59:34.666ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
20732025-03-25T21:59:34.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20742025-03-25T21:59:34.759ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
20752025-03-25T21:59:34.761ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20762025-03-25T21:59:34.763ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
20772025-03-25T21:59:34.763ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
20782025-03-25T21:59:34.764ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c file = illumos-utils/src/zone.rs:356
20792025-03-25T21:59:34.786ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
20802025-03-25T21:59:34.866ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
20812025-03-25T21:59:34.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20822025-03-25T21:59:34.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20832025-03-25T21:59:34.873ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c file = illumos-utils/src/zone.rs:394
20842025-03-25T21:59:34.938ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98 file = illumos-utils/src/zone.rs:356
20852025-03-25T21:59:34.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409 file = illumos-utils/src/zone.rs:356
20862025-03-25T21:59:35.016ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1 file = illumos-utils/src/zone.rs:356
20872025-03-25T21:59:35.029ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98 file = illumos-utils/src/zone.rs:394
20882025-03-25T21:59:35.045ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409 file = illumos-utils/src/zone.rs:394
20892025-03-25T21:59:35.071ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858 file = illumos-utils/src/zone.rs:356
20902025-03-25T21:59:35.082ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1 file = illumos-utils/src/zone.rs:394
20912025-03-25T21:59:35.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858 file = illumos-utils/src/zone.rs:394
20922025-03-25T21:59:35.282ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61434
20932025-03-25T21:59:35.300ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 13069 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61434 req_id = 4aac32d4-4941-4849-9cd4-09e27799e48a response_code = 200 uri = /baseboard
20942025-03-25T21:59:36.538ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
20952025-03-25T21:59:36.542ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
20962025-03-25T21:59:36.543ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
20972025-03-25T21:59:36.544ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
20982025-03-25T21:59:38.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
20992025-03-25T21:59:38.655ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21002025-03-25T21:59:39.377ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='569c08cf-9db1-4055-b901-566057d47f7f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21012025-03-25T21:59:39.377ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21022025-03-25T21:59:39.389ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='61325055-0442-4369-b915-b3330422094d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21032025-03-25T21:59:39.391ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c98fa7f5-5a32-4387-85d1-f6773deb58dc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21042025-03-25T21:59:39.391ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f92ee940-58a4-42f3-8249-a9824705ae7b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='34ded9f9-6acd-4674-9b03-fd07b770cbc8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21052025-03-25T21:59:39.392ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9b2c121d-9aab-432f-a298-243c5f5d5d62'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21062025-03-25T21:59:39.392ZINFOSledAgent (ServiceManager): Booting oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21072025-03-25T21:59:39.404ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c012c80c-52d7-47c3-9807-faedd94bc4a7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21082025-03-25T21:59:39.404ZINFOSledAgent (ServiceManager): Booting oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21092025-03-25T21:59:39.414ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21102025-03-25T21:59:39.428ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='13795291-2f49-447e-ae78-ff1a44ceb740'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21112025-03-25T21:59:39.428ZINFOSledAgent (ServiceManager): Booting oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21122025-03-25T21:59:39.438ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21132025-03-25T21:59:39.449ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21142025-03-25T21:59:42.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 71.177165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21152025-03-25T21:59:42.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 55.114895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21162025-03-25T21:59:42.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 61.915303ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21172025-03-25T21:59:42.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 50.208115ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21182025-03-25T21:59:43.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 69.023743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21192025-03-25T21:59:43.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 64.749955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21202025-03-25T21:59:43.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 41.104955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21212025-03-25T21:59:43.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 32.77694ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21222025-03-25T21:59:44.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 70.22915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21232025-03-25T21:59:44.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 117.057353ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21242025-03-25T21:59:44.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 108.882501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21252025-03-25T21:59:44.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 95.715938ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21262025-03-25T21:59:44.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 89.644054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21272025-03-25T21:59:44.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 124.348647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21282025-03-25T21:59:44.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 83.999006ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21292025-03-25T21:59:45.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 98.506782ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21302025-03-25T21:59:45.014ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='ec539d60-a406-4fe9-a658-fbc8b3fb545b'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21312025-03-25T21:59:45.015ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21322025-03-25T21:59:45.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 192.528151ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21332025-03-25T21:59:45.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 279.756791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21342025-03-25T21:59:45.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 178.824553ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21352025-03-25T21:59:45.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 193.641811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21362025-03-25T21:59:45.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 266.40248ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21372025-03-25T21:59:45.088ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21382025-03-25T21:59:45.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 161.917279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21392025-03-25T21:59:45.103ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21402025-03-25T21:59:45.110ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
21412025-03-25T21:59:45.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 199.877656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21422025-03-25T21:59:45.129ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21432025-03-25T21:59:45.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 268.688905ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21442025-03-25T21:59:45.239ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 573.573418ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21452025-03-25T21:59:45.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 556.544594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21462025-03-25T21:59:45.258ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9cb403e6-797e-4379-973b-713f596fb1b1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='901a656b-6262-42ad-91dd-3addce8dae1d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21472025-03-25T21:59:45.261ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='235ea8e4-7206-4d58-a587-19f94b38bcae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21482025-03-25T21:59:45.262ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
21492025-03-25T21:59:45.271ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
21502025-03-25T21:59:45.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 327.744097ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21512025-03-25T21:59:45.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 530.925209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21522025-03-25T21:59:45.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 455.607731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21532025-03-25T21:59:45.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 473.058618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21542025-03-25T21:59:45.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 435.430299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21552025-03-25T21:59:45.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 69.477019ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21562025-03-25T21:59:45.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 255.097446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21572025-03-25T21:59:45.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 31.419856ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
21582025-03-25T21:59:45.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 33.070358ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21592025-03-25T21:59:45.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 97.901204ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21602025-03-25T21:59:45.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 70.157939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
21612025-03-25T21:59:45.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 66.295832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21622025-03-25T21:59:45.918ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 235.80355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21632025-03-25T21:59:45.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 102.798525ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21642025-03-25T21:59:45.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 178.370006ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
21652025-03-25T21:59:45.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 755.628543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21662025-03-25T21:59:46.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 471.740939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21672025-03-25T21:59:46.010ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21682025-03-25T21:59:46.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 755.14115ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
21692025-03-25T21:59:46.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 594.36814ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21702025-03-25T21:59:46.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 504.674357ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21712025-03-25T21:59:46.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 663.850309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
21722025-03-25T21:59:46.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 46.624432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
21732025-03-25T21:59:46.115ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 66.554122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
21742025-03-25T21:59:46.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 943.872902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
21752025-03-25T21:59:46.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 594.147937ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
21762025-03-25T21:59:46.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 291.970038ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21772025-03-25T21:59:46.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 512.173362ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
21782025-03-25T21:59:46.206ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
21792025-03-25T21:59:46.207ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
21802025-03-25T21:59:46.239ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 223.36305ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21812025-03-25T21:59:46.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 94.154849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
21822025-03-25T21:59:46.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 61.664139ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
21832025-03-25T21:59:46.273ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
21842025-03-25T21:59:46.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 132.162397ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
21852025-03-25T21:59:46.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 132.289586ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
21862025-03-25T21:59:46.476ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.132267585s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
21872025-03-25T21:59:46.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 925.542559ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
21882025-03-25T21:59:46.515ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 883.722407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
21892025-03-25T21:59:46.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 495.811858ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
21902025-03-25T21:59:46.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 287.200369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
21912025-03-25T21:59:46.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 35.970333ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
21922025-03-25T21:59:46.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 1.30538246s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
21932025-03-25T21:59:46.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 56.974433ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
21942025-03-25T21:59:46.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 99.026919ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
21952025-03-25T21:59:46.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 867.502973ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
21962025-03-25T21:59:46.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 71.454526ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
21972025-03-25T21:59:46.843ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 209.108536ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
21982025-03-25T21:59:46.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 977.929956ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
21992025-03-25T21:59:46.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 225.717234ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22002025-03-25T21:59:46.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 913.057176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
22012025-03-25T21:59:46.957ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 890.2634ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
22022025-03-25T21:59:46.973ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.026613501s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
22032025-03-25T21:59:46.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 502.367128ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
22042025-03-25T21:59:47.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 679.049689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
22052025-03-25T21:59:47.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 593.347634ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
22062025-03-25T21:59:47.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 268.694154ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22072025-03-25T21:59:47.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.24783011s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
22082025-03-25T21:59:47.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 375.736544ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22092025-03-25T21:59:47.362ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 540.570116ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22102025-03-25T21:59:47.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 913.060822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
22112025-03-25T21:59:47.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 752.566352ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
22122025-03-25T21:59:47.472ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22132025-03-25T21:59:47.473ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22142025-03-25T21:59:47.473ZINFOSledAgent (ServiceManager): Booting oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22152025-03-25T21:59:47.484ZINFOSledAgent (ServiceManager): Booting oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22162025-03-25T21:59:47.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 500.548391ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
22172025-03-25T21:59:47.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.136795898s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
22182025-03-25T21:59:47.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 535.68785ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22192025-03-25T21:59:47.555ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
22202025-03-25T21:59:47.555ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22212025-03-25T21:59:47.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 818.608276ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
22222025-03-25T21:59:47.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.368231634s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
22232025-03-25T21:59:47.703ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 45.924129ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22242025-03-25T21:59:47.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 779.003794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
22252025-03-25T21:59:47.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 94.70123ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22262025-03-25T21:59:47.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 27.586126ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22272025-03-25T21:59:47.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 665.628543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
22282025-03-25T21:59:47.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.074465732s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22292025-03-25T21:59:47.997ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.008952977s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
22302025-03-25T21:59:48.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 242.83063ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22312025-03-25T21:59:48.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 819.885435ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
22322025-03-25T21:59:48.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 886.501118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
22332025-03-25T21:59:48.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 63.641302ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22342025-03-25T21:59:48.079ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 561.511388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
22352025-03-25T21:59:48.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.306228232s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
22362025-03-25T21:59:48.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 58.949029ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22372025-03-25T21:59:48.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 637.148882ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22382025-03-25T21:59:48.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 211.57535ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22392025-03-25T21:59:48.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 81.027165ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22402025-03-25T21:59:48.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.462876326s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
22412025-03-25T21:59:48.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 489.23321ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22422025-03-25T21:59:48.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 171.064064ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22432025-03-25T21:59:48.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 763.822602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
22442025-03-25T21:59:48.356ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.369112401s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
22452025-03-25T21:59:48.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 493.016065ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22462025-03-25T21:59:48.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 635.417818ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
22472025-03-25T21:59:48.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 594.547957ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22482025-03-25T21:59:48.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.390359214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
22492025-03-25T21:59:48.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.284669889s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
22502025-03-25T21:59:48.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 556.093366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
22512025-03-25T21:59:48.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.269538566s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
22522025-03-25T21:59:48.779ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 697.648911ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22532025-03-25T21:59:48.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 862.379008ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22542025-03-25T21:59:48.863ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 912.826122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
22552025-03-25T21:59:48.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 419.630858ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22562025-03-25T21:59:48.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 700.144188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
22572025-03-25T21:59:49.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 548.12355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
22582025-03-25T21:59:49.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.154230677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
22592025-03-25T21:59:49.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.120289001s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22602025-03-25T21:59:49.079ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 982.118388ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22612025-03-25T21:59:49.167ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.333055078s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
22622025-03-25T21:59:49.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 709.154016ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
22632025-03-25T21:59:49.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.166946429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
22642025-03-25T21:59:49.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 626.51189ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22652025-03-25T21:59:49.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 751.508115ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
22662025-03-25T21:59:49.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 899.317033ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22672025-03-25T21:59:49.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.096103085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
22682025-03-25T21:59:49.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 898.527897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
22692025-03-25T21:59:49.668ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.390722421s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22702025-03-25T21:59:49.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.183352109s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
22712025-03-25T21:59:49.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.088469551s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
22722025-03-25T21:59:49.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 1.210890204s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
22732025-03-25T21:59:49.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 915.291321ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
22742025-03-25T21:59:49.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 834.195157ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
22752025-03-25T21:59:49.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 540.353776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
22762025-03-25T21:59:49.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.201563645s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
22772025-03-25T21:59:49.989ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.079928984s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22782025-03-25T21:59:50.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.22440988s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
22792025-03-25T21:59:50.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.386128238s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
22802025-03-25T21:59:50.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 899.333809ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22812025-03-25T21:59:50.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.489123405s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
22822025-03-25T21:59:50.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 879.02794ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
22832025-03-25T21:59:50.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 957.581616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
22842025-03-25T21:59:50.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 624.133789ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
22852025-03-25T21:59:50.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 545.178043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
22862025-03-25T21:59:50.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 1.309117759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
22872025-03-25T21:59:50.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 974.568468ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
22882025-03-25T21:59:50.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.472775668s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
22892025-03-25T21:59:50.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 1.120519481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
22902025-03-25T21:59:50.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.068016001s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
22912025-03-25T21:59:50.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 664.001737ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
22922025-03-25T21:59:51.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 1.397128679s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
22932025-03-25T21:59:51.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.031609058s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
22942025-03-25T21:59:51.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.498913244s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
22952025-03-25T21:59:51.096ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 522.6256ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
22962025-03-25T21:59:51.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 532.265082ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
22972025-03-25T21:59:51.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 945.101445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
22982025-03-25T21:59:51.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.303180733s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
22992025-03-25T21:59:51.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 622.958468ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23002025-03-25T21:59:51.311ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.138725913s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23012025-03-25T21:59:51.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 693.944797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23022025-03-25T21:59:51.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.168276635s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
23032025-03-25T21:59:51.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 863.574303ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23042025-03-25T21:59:51.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.466651136s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
23052025-03-25T21:59:51.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 563.544241ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23062025-03-25T21:59:51.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 721.924719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23072025-03-25T21:59:51.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.382040318s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
23082025-03-25T21:59:51.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 1.433663279s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
23092025-03-25T21:59:51.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 677.447174ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23102025-03-25T21:59:51.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.397149774s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
23112025-03-25T21:59:51.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 1.003718717s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23122025-03-25T21:59:52.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.315171249s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
23132025-03-25T21:59:52.099ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 572.685918ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23142025-03-25T21:59:52.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 558.232377ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
23152025-03-25T21:59:52.225ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.268383926s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23162025-03-25T21:59:52.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 642.876031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
23172025-03-25T21:59:52.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 766.197096ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23182025-03-25T21:59:52.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.300021437s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23192025-03-25T21:59:52.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.318694802s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23202025-03-25T21:59:52.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.125406762s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23212025-03-25T21:59:52.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.392611802s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
23222025-03-25T21:59:52.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 556.700005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
23232025-03-25T21:59:52.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 767.507858ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23242025-03-25T21:59:52.682ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 842.36469ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
23252025-03-25T21:59:52.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.203475851s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23262025-03-25T21:59:52.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.378680015s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
23272025-03-25T21:59:52.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 991.776498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
23282025-03-25T21:59:52.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 980.276537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23292025-03-25T21:59:53.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.378399959s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
23302025-03-25T21:59:53.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.031887775s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
23312025-03-25T21:59:53.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.433594961s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
23322025-03-25T21:59:53.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 767.639019ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23332025-03-25T21:59:53.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 1.456955417s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
23342025-03-25T21:59:53.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 952.53581ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
23352025-03-25T21:59:53.397ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 613.59318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23362025-03-25T21:59:53.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.122883678s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
23372025-03-25T21:59:53.503ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 853.191762ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23382025-03-25T21:59:53.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.363437206s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
23392025-03-25T21:59:53.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 756.560754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23402025-03-25T21:59:53.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.112026755s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23412025-03-25T21:59:53.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 978.105634ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23422025-03-25T21:59:53.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.068362857s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
23432025-03-25T21:59:53.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.179068171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23442025-03-25T21:59:53.922ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.391677718s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
23452025-03-25T21:59:53.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 571.458826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23462025-03-25T21:59:53.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 799.22455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23472025-03-25T21:59:54.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.076278127s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23482025-03-25T21:59:54.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 644.09338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
23492025-03-25T21:59:54.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.496143238s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
23502025-03-25T21:59:54.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 801.970333ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
23512025-03-25T21:59:54.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 562.313336ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23522025-03-25T21:59:54.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 960.307003ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23532025-03-25T21:59:54.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 944.427879ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
23542025-03-25T21:59:54.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 583.353146ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
23552025-03-25T21:59:54.660ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 570.833118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23562025-03-25T21:59:54.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 950.388828ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
23572025-03-25T21:59:54.844ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 697.133664ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23582025-03-25T21:59:54.961ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 578.526294ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23592025-03-25T21:59:55.102ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.13453676s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
23602025-03-25T21:59:55.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 748.037598ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23612025-03-25T21:59:55.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 655.666082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23622025-03-25T21:59:55.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.241040069s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23632025-03-25T21:59:55.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.343131259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
23642025-03-25T21:59:55.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 620.528088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
23652025-03-25T21:59:55.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.05561415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23662025-03-25T21:59:55.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.356622213s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
23672025-03-25T21:59:55.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.085999018s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23682025-03-25T21:59:55.516ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.110985305s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
23692025-03-25T21:59:55.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 939.049771ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
23702025-03-25T21:59:55.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 879.794054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
23712025-03-25T21:59:55.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.078101271s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23722025-03-25T21:59:55.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 1.297841186s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23732025-03-25T21:59:55.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 597.692832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23742025-03-25T21:59:55.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 926.645004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
23752025-03-25T21:59:55.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 968.865951ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
23762025-03-25T21:59:55.711ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 756.889872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
23772025-03-25T21:59:55.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.359708503s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23782025-03-25T21:59:55.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.438290114s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
23792025-03-25T21:59:55.971ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 1.261394422s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
23802025-03-25T21:59:56.198ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 510.160845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23812025-03-25T21:59:56.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.278826882s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
23822025-03-25T21:59:56.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.040676165s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
23832025-03-25T21:59:56.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 844.682873ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
23842025-03-25T21:59:56.476ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 876.370058ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
23852025-03-25T21:59:56.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.177626761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
23862025-03-25T21:59:56.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 939.041958ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
23872025-03-25T21:59:56.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 969.694067ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
23882025-03-25T21:59:56.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.419913775s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
23892025-03-25T21:59:56.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 912.639108ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
23902025-03-25T21:59:56.650ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 575.396083ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
23912025-03-25T21:59:56.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.381424052s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
23922025-03-25T21:59:56.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 721.097845ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
23932025-03-25T21:59:56.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 799.780257ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
23942025-03-25T21:59:56.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 637.730095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
23952025-03-25T21:59:56.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 754.050411ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
23962025-03-25T21:59:57.172ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
23972025-03-25T21:59:57.172ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
23982025-03-25T21:59:57.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.134650662s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
23992025-03-25T21:59:57.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.352340669s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24002025-03-25T21:59:57.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 921.554119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
24012025-03-25T21:59:57.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.45478204s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24022025-03-25T21:59:57.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 968.071914ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24032025-03-25T21:59:57.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.041885537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24042025-03-25T21:59:57.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.256726887s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
24052025-03-25T21:59:57.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 880.844016ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24062025-03-25T21:59:57.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.194955801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
24072025-03-25T21:59:57.483ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.427833561s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24082025-03-25T21:59:57.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 517.539955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24092025-03-25T21:59:57.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 714.639575ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
24102025-03-25T21:59:57.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.323079614s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24112025-03-25T21:59:57.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 31.110885ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24122025-03-25T21:59:57.562ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 888.270425ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24132025-03-25T21:59:57.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 146.488947ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24142025-03-25T21:59:57.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 688.108507ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
24152025-03-25T21:59:57.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.195677226s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24162025-03-25T21:59:57.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 123.919412ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24172025-03-25T21:59:57.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 448.961573ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24182025-03-25T21:59:58.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.081774443s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
24192025-03-25T21:59:58.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.224049212s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24202025-03-25T21:59:58.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 764.575101ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
24212025-03-25T21:59:58.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 680.03633ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
24222025-03-25T21:59:58.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 1.174528368s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
24232025-03-25T21:59:58.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 503.118297ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24242025-03-25T21:59:58.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 1.484620012s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
24252025-03-25T21:59:58.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 562.66847ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24262025-03-25T21:59:58.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 969.367206ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24272025-03-25T21:59:58.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 782.539441ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
24282025-03-25T21:59:58.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 823.258947ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24292025-03-25T21:59:58.461ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.280647676s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24302025-03-25T21:59:58.610ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.47408529s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24312025-03-25T21:59:58.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca") failed: Property not found. retry in 1.159358243s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
24322025-03-25T21:59:58.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 669.939245ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
24332025-03-25T21:59:58.770ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.019585842s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24342025-03-25T21:59:58.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a") failed: Property not found. retry in 1.156645929s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
24352025-03-25T21:59:58.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.440590686s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24362025-03-25T21:59:58.873ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.084367975s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24372025-03-25T21:59:58.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 979.173004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
24382025-03-25T21:59:58.893ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.111277212s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24392025-03-25T21:59:58.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 801.303862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24402025-03-25T21:59:58.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 866.617195ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24412025-03-25T21:59:59.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.12620043s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
24422025-03-25T21:59:59.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da") failed: Property not found. retry in 1.428989364s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
24432025-03-25T21:59:59.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.417840056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24442025-03-25T21:59:59.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.026361214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24452025-03-25T21:59:59.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.290209418s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24462025-03-25T21:59:59.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.447951301s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
24472025-03-25T21:59:59.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931") failed: Property not found. retry in 1.250189595s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
24482025-03-25T21:59:59.736ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 774.362391ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24492025-03-25T21:59:59.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.353146963s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24502025-03-25T21:59:59.804ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 593.646796ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24512025-03-25T21:59:59.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 1.099356374s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24522025-03-25T21:59:59.863ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 792.086791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
24532025-03-25T21:59:59.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 1.274588738s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
24542025-03-25T21:59:59.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.154112699s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24552025-03-25T22:00:00.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.186558954s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24562025-03-25T22:00:00.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 593.681364ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24572025-03-25T22:00:00.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.055380416s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
24582025-03-25T22:00:00.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.400500087s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24592025-03-25T22:00:00.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 519.188704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24602025-03-25T22:00:00.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 828.557501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24612025-03-25T22:00:00.528ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 550.657297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24622025-03-25T22:00:00.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 568.392643ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24632025-03-25T22:00:00.670ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 657.020783ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
24642025-03-25T22:00:00.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.299282377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24652025-03-25T22:00:00.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 904.560882ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24662025-03-25T22:00:00.823ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.4207984s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
24672025-03-25T22:00:00.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 552.501978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24682025-03-25T22:00:00.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 1.295737596s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24692025-03-25T22:00:01.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 674.400642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24702025-03-25T22:00:01.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 730.069919ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24712025-03-25T22:00:01.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 784.465827ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24722025-03-25T22:00:01.167ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d") failed: Property not found. retry in 950.756686ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
24732025-03-25T22:00:01.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.27489492s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24742025-03-25T22:00:01.250ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 512.846539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24752025-03-25T22:00:01.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 617.878027ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24762025-03-25T22:00:01.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110") failed: Property not found. retry in 1.185450799s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
24772025-03-25T22:00:01.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308") failed: Property not found. retry in 1.44237683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
24782025-03-25T22:00:01.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 1.084005556s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24792025-03-25T22:00:01.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 1.27918215s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24802025-03-25T22:00:01.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.217298115s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24812025-03-25T22:00:01.779ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 578.223817ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24822025-03-25T22:00:01.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766") failed: Property not found. retry in 1.219470092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
24832025-03-25T22:00:01.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 685.059937ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24842025-03-25T22:00:01.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.453982724s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
24852025-03-25T22:00:01.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.203076357s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24862025-03-25T22:00:02.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 559.98116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24872025-03-25T22:00:02.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 1.256288923s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
24882025-03-25T22:00:02.263ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.098518469s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
24892025-03-25T22:00:02.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 1.497678142s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
24902025-03-25T22:00:02.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 554.054423ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24912025-03-25T22:00:02.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 724.523115ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
24922025-03-25T22:00:02.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 623.430755ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24932025-03-25T22:00:02.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.437377699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
24942025-03-25T22:00:02.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 732.432331ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
24952025-03-25T22:00:02.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 522.111264ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
24962025-03-25T22:00:03.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 1.190208734s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
24972025-03-25T22:00:03.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 842.994763ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
24982025-03-25T22:00:03.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b") failed: Property not found. retry in 1.238933995s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
24992025-03-25T22:00:03.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 689.39939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
25002025-03-25T22:00:03.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 814.569891ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
25012025-03-25T22:00:03.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.261855499s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
25022025-03-25T22:00:03.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.209420017s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
25032025-03-25T22:00:03.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 828.80518ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
25042025-03-25T22:00:03.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 611.839266ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
25052025-03-25T22:00:03.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481") failed: Property not found. retry in 866.595112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
25062025-03-25T22:00:03.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 859.17571ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
25072025-03-25T22:00:04.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.286597475s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
25082025-03-25T22:00:04.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387") failed: Property not found. retry in 1.419204599s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
25092025-03-25T22:00:04.205ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 771.156159ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
25102025-03-25T22:00:04.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 779.937599ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
25112025-03-25T22:00:04.302ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98") failed: Property not found. retry in 905.468338ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
25122025-03-25T22:00:04.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 1.214318222s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
25132025-03-25T22:00:04.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 666.691789ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
25142025-03-25T22:00:04.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409") failed: Property not found. retry in 1.418855702s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
25152025-03-25T22:00:04.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf") failed: Property not found. retry in 936.76209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
25162025-03-25T22:00:04.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28") failed: Property not found. retry in 1.337024928s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
25172025-03-25T22:00:05.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c") failed: Property not found. retry in 782.416438ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
25182025-03-25T22:00:05.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1") failed: Property not found. retry in 1.188904891s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
25192025-03-25T22:00:05.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858") failed: Property not found. retry in 1.348336306s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
25202025-03-25T22:00:05.404ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64459
25212025-03-25T22:00:05.423ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9981 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64459 req_id = 4793721d-f735-402b-b810-f79bb6db1253 response_code = 200 uri = /baseboard
25222025-03-25T22:00:05.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751") failed: Property not found. retry in 1.094164522s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
25232025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_f41042a4-ad13-46d6-859e-bff1b46ae766
25242025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_f578ebd7-76c9-43f2-8d8c-99a164224c1c
25252025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_external_dns_58d382a7-99da-40a7-bc9f-2da7e9b156c1
25262025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_203169ef-9fe5-4a34-b981-5db138d44110
25272025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_clickhouse_f44205a7-6f8b-400e-be5b-2df60f5cb751
25282025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_external_dns_d42076c6-06fe-4102-a978-c7d0a8dffb98
25292025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_d0f52952-f214-42ac-b892-8e4bfacbc8da
25302025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_dc04dd71-e9ce-4d94-8637-d87f47eb7409
25312025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_5279fc0d-6158-4549-b943-9e54e698576a
25322025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_9111bbf6-8db9-46b2-8b3d-67ae35f2b931
25332025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_128b0bf2-5487-4645-8c6f-90a651cbc65d
25342025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_d96b5518-7771-4a6a-a482-8a89187c6481
25352025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_nexus_76a4636e-6952-47a1-8a71-cd6816e00858
25362025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_8d8fe429-0836-4c1c-830d-f6500bc959cf
25372025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_a18f8359-ed3e-42ff-ad0c-f9bb63497f28
25382025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_ae94c19c-730a-47e6-960b-263c29dea9ca
25392025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_86bcfd88-d0a3-4cc5-aa0c-5b887d3a1308
25402025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_oximeter_ec539d60-a406-4fe9-a658-fbc8b3fb545b
25412025-03-25T22:00:06.736ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3387 zone = oxz_crucible_pantry_12db6227-4fe9-4ab3-8153-dae270d07387
25422025-03-25T22:00:06.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
25432025-03-25T22:00:06.748ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
25442025-03-25T22:00:06.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33779540 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56768 req_id = 2e8fa887-ce68-405a-826b-18b206ca818a response_code = 200 uri = /omicron-config
25452025-03-25T22:00:06.792ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1358
25462025-03-25T22:00:06.834ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:738
25472025-03-25T22:00:06.841ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:751
25482025-03-25T22:00:06.878ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:951
25492025-03-25T22:00:08.427ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25502025-03-25T22:00:08.613ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25512025-03-25T22:00:08.733ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25522025-03-25T22:00:08.892ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25532025-03-25T22:00:09.133ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25542025-03-25T22:00:09.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25552025-03-25T22:00:09.429ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25562025-03-25T22:00:09.853ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25572025-03-25T22:00:10.253ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25582025-03-25T22:00:10.557ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25592025-03-25T22:00:10.814ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.768932734s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25602025-03-25T22:00:10.853ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25612025-03-25T22:00:11.418ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25622025-03-25T22:00:11.916ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25632025-03-25T22:00:12.638ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/c7210e4b-5a81-4ec8-b8fe-816a9508dc74/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1011
25642025-03-25T22:00:18.320ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6b67bdd0-9b7a-4b85-a3a0-aa2da231a620", "content-length": "173", "date": "Tue, 25 Mar 2025 22:00:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c7210e4b-5a81-4ec8-b8fe-816a9508dc74\"", request_id: "6b67bdd0-9b7a-4b85-a3a0-aa2da231a620" } file = sled-agent/src/rack_setup/service.rs:1011
25652025-03-25T22:00:19.563ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d2c0fb27-9d07-4379-b88b-45270327d615", "content-length": "173", "date": "Tue, 25 Mar 2025 22:00:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c7210e4b-5a81-4ec8-b8fe-816a9508dc74\"", request_id: "d2c0fb27-9d07-4379-b88b-45270327d615" } file = sled-agent/src/rack_setup/service.rs:1011
25662025-03-25T22:00:20.124ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25672025-03-25T22:00:21.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42571
25682025-03-25T22:00:21.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42571 req_id = 8a2b9773-bb0c-47ae-acee-4cd9ebe18af9 response_code = 200 uri = /vpc-routes
25692025-03-25T22:00:21.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48917
25702025-03-25T22:00:21.317ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25712025-03-25T22:00:21.317ZINFOSledAgent (ArtifactStore): No ledger in /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:186 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25722025-03-25T22:00:21.317ZINFOSledAgent (ArtifactStore): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/.artifact-config.json.tmp file = common/src/ledger.rs:197 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25732025-03-25T22:00:21.319ZINFOSledAgent (ArtifactStore): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/.artifact-config.json.tmp file = common/src/ledger.rs:197 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25742025-03-25T22:00:21.320ZINFOSledAgent (ArtifactStore): Starting delete reconciler file = sled-agent/src/artifact_store.rs:521 generation = 1 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25752025-03-25T22:00:21.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48917 req_id = 0da201e0-01d9-41e4-814e-1592f719dc54 response_code = 204 uri = /artifacts-config
25762025-03-25T22:00:21.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25772025-03-25T22:00:21.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25782025-03-25T22:00:21.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48917 req_id = b3c71fb8-22ac-4970-a224-2736a8e48111 response_code = 200 uri = /artifacts
25792025-03-25T22:00:21.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38123
25802025-03-25T22:00:21.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38123 req_id = ac640bb5-b944-4195-8d13-0b8a7254ba96 response_code = 200 uri = /vpc-routes
25812025-03-25T22:00:21.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44527
25822025-03-25T22:00:21.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25832025-03-25T22:00:21.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25842025-03-25T22:00:21.377ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
25852025-03-25T22:00:21.378ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
25862025-03-25T22:00:21.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32840
25872025-03-25T22:00:21.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32840 req_id = ed9b84ce-0f99-4fa8-b667-f2c15976978d response_code = 200 uri = /vpc-routes
25882025-03-25T22:00:21.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
25892025-03-25T22:00:21.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42571 req_id = 1ea103fe-e28a-49ce-9d9a-03d184808102 response_code = 204 uri = /eip-gateways
25902025-03-25T22:00:21.396ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25912025-03-25T22:00:21.396ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
25922025-03-25T22:00:21.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47341
25932025-03-25T22:00:21.404ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25942025-03-25T22:00:21.405ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
25952025-03-25T22:00:21.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47341 req_id = da891f6b-e71c-44d6-9a6e-556305b6144f response_code = 204 uri = /artifacts-config
25962025-03-25T22:00:21.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25972025-03-25T22:00:21.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47341 req_id = 9d13ba96-2b40-4f82-98c7-3b94f2b215e4 response_code = 200 uri = /artifacts
25982025-03-25T22:00:21.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58840
25992025-03-25T22:00:21.429ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
26002025-03-25T22:00:21.429ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
26012025-03-25T22:00:21.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 415 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58840 req_id = feb598b6-2739-4596-bab1-530c13629d6a response_code = 204 uri = /artifacts-config
26022025-03-25T22:00:21.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26032025-03-25T22:00:21.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58840 req_id = 43d4b877-fc91-4aed-9fe4-5774499a0923 response_code = 200 uri = /artifacts
26042025-03-25T22:00:21.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26052025-03-25T22:00:21.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
26062025-03-25T22:00:21.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
26072025-03-25T22:00:21.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38123 req_id = ac9cb031-39af-4074-859a-1ac491fff33f response_code = 204 uri = /eip-gateways
26082025-03-25T22:00:21.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-03-25T22:00:21.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
26102025-03-25T22:00:21.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33139
26112025-03-25T22:00:21.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33139 req_id = 92e52540-4fb6-4294-900e-7fc4922277e2 response_code = 200 uri = /v2p
26122025-03-25T22:00:21.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63579
26132025-03-25T22:00:21.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26142025-03-25T22:00:21.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26152025-03-25T22:00:21.480ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
26162025-03-25T22:00:21.487ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
26172025-03-25T22:00:21.493ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-03-25T22:00:21.493ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
26192025-03-25T22:00:21.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64340
26202025-03-25T22:00:21.508ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
26212025-03-25T22:00:21.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32840 req_id = 23f0d143-e71f-4cab-a010-a5f1da721026 response_code = 204 uri = /eip-gateways
26222025-03-25T22:00:21.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232025-03-25T22:00:21.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
26242025-03-25T22:00:21.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26252025-03-25T22:00:21.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26262025-03-25T22:00:21.530ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
26272025-03-25T22:00:21.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37496
26282025-03-25T22:00:21.540ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
26292025-03-25T22:00:21.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37496 req_id = 4890b8f7-241c-4de4-8928-f395b3167cc7 response_code = 200 uri = /v2p
26302025-03-25T22:00:21.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312025-03-25T22:00:21.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
26322025-03-25T22:00:21.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332025-03-25T22:00:21.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
26342025-03-25T22:00:21.584ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26352025-03-25T22:00:21.584ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
26362025-03-25T22:00:21.607ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-03-25T22:00:21.607ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
26382025-03-25T22:00:21.625ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26392025-03-25T22:00:21.625ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
26402025-03-25T22:00:21.643ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26412025-03-25T22:00:21.643ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
26422025-03-25T22:00:21.663ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26432025-03-25T22:00:21.663ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
26442025-03-25T22:00:21.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36824
26452025-03-25T22:00:21.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36824 req_id = 27fccbaa-15b5-4e7e-9621-d024f2c44443 response_code = 200 uri = /v2p
26462025-03-25T22:00:21.682ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472025-03-25T22:00:21.682ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
26482025-03-25T22:00:21.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38123 req_id = 684f15d2-a238-455a-8daf-16ab5346b688 response_code = 204 uri = /vpc-routes
26492025-03-25T22:00:21.699ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
26502025-03-25T22:00:21.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 593 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42571 req_id = 5521cdf3-0012-44af-b38b-0dc3856ebf1b response_code = 204 uri = /vpc-routes
26512025-03-25T22:00:21.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-03-25T22:00:21.704ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
26532025-03-25T22:00:21.715ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
26542025-03-25T22:00:21.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1071 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32840 req_id = 60988549-4523-4398-9a08-1d705f28e229 response_code = 204 uri = /vpc-routes
26552025-03-25T22:00:21.722ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26562025-03-25T22:00:21.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
26572025-03-25T22:00:21.740ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582025-03-25T22:00:21.740ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
26592025-03-25T22:00:21.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-03-25T22:00:21.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
26612025-03-25T22:00:21.777ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26622025-03-25T22:00:21.777ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
26632025-03-25T22:00:21.792ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26642025-03-25T22:00:21.792ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
26652025-03-25T22:00:21.813ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26662025-03-25T22:00:21.813ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
26672025-03-25T22:00:21.832ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26682025-03-25T22:00:21.833ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
26692025-03-25T22:00:21.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 461730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44527 req_id = b24a78d9-579f-4388-968d-1ae0ba9804c4 response_code = 200 uri = /inventory
26702025-03-25T22:00:21.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26712025-03-25T22:00:21.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
26722025-03-25T22:00:21.879ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26732025-03-25T22:00:21.879ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
26742025-03-25T22:00:21.897ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26752025-03-25T22:00:21.897ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
26762025-03-25T22:00:21.917ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26772025-03-25T22:00:21.917ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
26782025-03-25T22:00:21.936ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26792025-03-25T22:00:21.936ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
26802025-03-25T22:00:21.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 464536 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63579 req_id = 77adeba3-5747-49e8-a566-f695c14fb5e4 response_code = 200 uri = /inventory
26812025-03-25T22:00:21.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26822025-03-25T22:00:21.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
26832025-03-25T22:00:21.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 473826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64340 req_id = 506ead91-35f2-467c-a1dc-12f041d4171d response_code = 200 uri = /inventory
26842025-03-25T22:00:22.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63085
26852025-03-25T22:00:22.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26862025-03-25T22:00:22.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26872025-03-25T22:00:22.253ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
26882025-03-25T22:00:22.254ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
26892025-03-25T22:00:22.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26902025-03-25T22:00:22.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
26912025-03-25T22:00:22.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26922025-03-25T22:00:22.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
26932025-03-25T22:00:22.321ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26942025-03-25T22:00:22.321ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
26952025-03-25T22:00:22.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26962025-03-25T22:00:22.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
26972025-03-25T22:00:22.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26982025-03-25T22:00:22.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
26992025-03-25T22:00:22.408ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27002025-03-25T22:00:22.408ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
27012025-03-25T22:00:22.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27022025-03-25T22:00:22.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
27032025-03-25T22:00:22.464ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27042025-03-25T22:00:22.464ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
27052025-03-25T22:00:22.496ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27062025-03-25T22:00:22.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
27072025-03-25T22:00:22.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63085 req_id = e08434dd-995c-424e-8ad2-4ae4a9c41627 response_code = 200 uri = /inventory
27082025-03-25T22:00:22.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49621
27092025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27102025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27112025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27122025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27132025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27142025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27152025-03-25T22:00:22.918ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27162025-03-25T22:00:22.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49621 req_id = 58d079d5-0931-4ea7-b513-cb9ab029f551 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27172025-03-25T22:00:22.919ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1021
27182025-03-25T22:00:22.923ZINFOSledAgent (RSS): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
27192025-03-25T22:00:22.924ZINFOSledAgent (RSS): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
27202025-03-25T22:00:23.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56727
27212025-03-25T22:00:23.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27222025-03-25T22:00:23.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27232025-03-25T22:00:23.184ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
27242025-03-25T22:00:23.184ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
27252025-03-25T22:00:23.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27262025-03-25T22:00:23.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
27272025-03-25T22:00:23.228ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27282025-03-25T22:00:23.229ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
27292025-03-25T22:00:23.260ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302025-03-25T22:00:23.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
27312025-03-25T22:00:23.286ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27322025-03-25T22:00:23.286ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
27332025-03-25T22:00:23.313ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27342025-03-25T22:00:23.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
27352025-03-25T22:00:23.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27362025-03-25T22:00:23.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
27372025-03-25T22:00:23.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27382025-03-25T22:00:23.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
27392025-03-25T22:00:23.389ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27402025-03-25T22:00:23.389ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
27412025-03-25T22:00:23.418ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422025-03-25T22:00:23.418ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
27432025-03-25T22:00:23.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56727 req_id = f7acb572-3aed-4a09-a0ec-402aa3a75578 response_code = 200 uri = /inventory
27442025-03-25T22:00:23.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51966
27452025-03-25T22:00:23.450ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27462025-03-25T22:00:23.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27472025-03-25T22:00:23.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27482025-03-25T22:00:23.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27492025-03-25T22:00:23.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27502025-03-25T22:00:23.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27512025-03-25T22:00:23.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522025-03-25T22:00:23.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51966 req_id = 7eb97cfa-8a35-42f5-ba7c-03a220295ae2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27532025-03-25T22:00:24.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58652
27542025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27552025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27562025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27572025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27582025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27592025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27602025-03-25T22:00:24.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27612025-03-25T22:00:24.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58652 req_id = 073de3ff-193e-4cbe-8e04-88c2a6f9c6dc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27622025-03-25T22:00:24.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44844
27632025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27642025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27652025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27662025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27672025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27682025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27692025-03-25T22:00:24.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27702025-03-25T22:00:24.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44844 req_id = 737ff46d-672d-418a-b57d-1eceaf5e4a58 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27712025-03-25T22:00:28.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56553
27722025-03-25T22:00:28.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56553 req_id = 1c652f72-00fb-4a08-85d0-e503473c9218 response_code = 200 uri = /vpc-routes
27732025-03-25T22:00:28.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
27742025-03-25T22:00:28.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56553 req_id = 3e400f6f-974c-4d67-819b-4137741c80a1 response_code = 204 uri = /eip-gateways
27752025-03-25T22:00:28.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56553 req_id = a32c054e-e124-4946-a948-3629fe6425ba response_code = 204 uri = /vpc-routes
27762025-03-25T22:00:35.466ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44729
27772025-03-25T22:00:35.466ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44729 req_id = c49dc784-77af-445f-88ab-c2d768bfb200 response_code = 200 uri = /baseboard
27782025-03-25T22:00:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
27792025-03-25T22:00:36.541ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
27802025-03-25T22:00:36.542ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
27812025-03-25T22:00:36.545ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
27822025-03-25T22:00:51.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42775
27832025-03-25T22:00:51.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42775 req_id = 610e9bdd-359a-4b4f-b5da-cd900c794180 response_code = 200 uri = /vpc-routes
27842025-03-25T22:00:51.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65222
27852025-03-25T22:00:51.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65222 req_id = e5ef5388-aa89-4183-a614-41e013a19b02 response_code = 200 uri = /vpc-routes
27862025-03-25T22:00:51.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
27872025-03-25T22:00:51.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65222 req_id = cad7c236-9058-4489-bc44-6b80994d8007 response_code = 204 uri = /eip-gateways
27882025-03-25T22:00:51.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65222 req_id = 8e9822f3-e233-4eaf-bb98-1682f07b7c56 response_code = 204 uri = /vpc-routes
27892025-03-25T22:00:51.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
27902025-03-25T22:00:51.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42775 req_id = 21ee2be1-a772-4c14-aa8f-a2d599e62b99 response_code = 204 uri = /eip-gateways
27912025-03-25T22:00:51.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42775 req_id = 89e68ef2-91c8-4ec8-ab9e-6ebfac432d00 response_code = 204 uri = /vpc-routes
27922025-03-25T22:00:51.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38213
27932025-03-25T22:00:51.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38213 req_id = c27fe77d-f682-4340-8244-f6a4c0d9a02b response_code = 200 uri = /v2p
27942025-03-25T22:00:51.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49254
27952025-03-25T22:00:51.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49254 req_id = a842d31f-df60-4754-8430-79836ef86f5e response_code = 200 uri = /vpc-routes
27962025-03-25T22:00:51.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40309
27972025-03-25T22:00:51.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40309 req_id = 96e3ce51-b72c-4dcb-aec9-fcfa00777f4f response_code = 200 uri = /v2p
27982025-03-25T22:00:51.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45634
27992025-03-25T22:00:51.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28002025-03-25T22:00:51.381ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28012025-03-25T22:00:51.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152852 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45634 req_id = 8abdf191-59bd-47f2-8e74-2d27bf955d8f response_code = 204 uri = /switch-ports
28022025-03-25T22:00:51.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54426
28032025-03-25T22:00:51.452ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28042025-03-25T22:00:51.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49254 req_id = cc5466da-e196-4692-b7e6-eefed57f09f0 response_code = 204 uri = /eip-gateways
28052025-03-25T22:00:51.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49166
28062025-03-25T22:00:51.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52472
28072025-03-25T22:00:51.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28082025-03-25T22:00:51.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49166 req_id = 64a9c3dc-b271-4137-b268-79da765f4500 response_code = 200 uri = /v2p
28092025-03-25T22:00:51.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45634 req_id = 40e8eebc-17f2-459b-bb2f-99c4bc15ba34 response_code = 200 uri = /network-bootstore-config
28102025-03-25T22:00:51.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49254 req_id = c0ebb763-27f9-46ab-b88f-1e54464b22ac response_code = 204 uri = /vpc-routes
28112025-03-25T22:00:51.496ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
28122025-03-25T22:00:51.497ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
28132025-03-25T22:00:51.497ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
28142025-03-25T22:00:51.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28152025-03-25T22:00:51.502ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
28162025-03-25T22:00:51.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45634 req_id = 5fb60869-0a9f-41bf-917a-c7646d5cd459 response_code = 204 uri = /network-bootstore-config
28172025-03-25T22:00:51.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28182025-03-25T22:00:51.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54426 req_id = f7957bd7-0266-4560-8291-9a9254a6ad28 response_code = 204 uri = /switch-ports
28192025-03-25T22:00:51.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54426 req_id = bf1bc54a-b33d-4dae-9c23-df3e967fdb3c response_code = 200 uri = /network-bootstore-config
28202025-03-25T22:00:51.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28212025-03-25T22:00:51.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52472 req_id = fb4234e1-56a7-4e6d-b29b-758e2917dccf response_code = 204 uri = /switch-ports
28222025-03-25T22:00:51.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52472 req_id = f5bed844-e0ad-4abe-b4b8-a6b34e9867c5 response_code = 200 uri = /network-bootstore-config
28232025-03-25T22:01:05.500ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62626
28242025-03-25T22:01:05.500ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62626 req_id = 1da18954-91ee-4588-947b-9e88b0c6289c response_code = 200 uri = /baseboard
28252025-03-25T22:01:13.574ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:56707 remote_addr = [fd00:1122:3344:101::d]:55665 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
28262025-03-25T22:01:13.605ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30447 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = eea688de-f783-4457-9dab-f4e0d4ad6bc2 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
28272025-03-25T22:01:21.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38895
28282025-03-25T22:01:21.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38895 req_id = 405ad47e-a84d-480d-b201-f4b31d86fc1e response_code = 200 uri = /v2p
28292025-03-25T22:01:21.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41702
28302025-03-25T22:01:21.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41702 req_id = 968b558a-a6d3-4844-bcef-695694331a25 response_code = 200 uri = /vpc-routes
28312025-03-25T22:01:21.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42846
28322025-03-25T22:01:21.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28332025-03-25T22:01:21.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28342025-03-25T22:01:21.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42846 req_id = 459d4ece-9aae-4687-9b72-67bb6bc21d43 response_code = 204 uri = /switch-ports
28352025-03-25T22:01:21.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33441
28362025-03-25T22:01:21.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28372025-03-25T22:01:21.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41702 req_id = 771d8825-d06a-4567-afe0-66b23588ab9f response_code = 204 uri = /eip-gateways
28382025-03-25T22:01:21.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33441 req_id = 9a0548b1-0e17-42d6-96ea-dc55845d9d95 response_code = 200 uri = /vpc-routes
28392025-03-25T22:01:21.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42846 req_id = 4559f4f3-b36d-47ab-a478-4c67fc078098 response_code = 200 uri = /network-bootstore-config
28402025-03-25T22:01:21.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53932
28412025-03-25T22:01:21.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53932 req_id = 0a7f5cbe-c4f8-46d9-830c-10f29f57e26c response_code = 200 uri = /vpc-routes
28422025-03-25T22:01:21.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41702 req_id = 61c16286-5182-43f6-ac5a-8c8541dab2fc response_code = 204 uri = /vpc-routes
28432025-03-25T22:01:21.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28442025-03-25T22:01:21.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53932 req_id = 393e8c44-e042-4aa2-85d8-afdb53d17cbc response_code = 204 uri = /eip-gateways
28452025-03-25T22:01:21.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28462025-03-25T22:01:21.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33441 req_id = af51b482-90b3-45c2-abea-3515e1de0d52 response_code = 204 uri = /eip-gateways
28472025-03-25T22:01:21.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33441 req_id = 31aaef71-39d0-4557-8f73-d2f7e8a7baa1 response_code = 204 uri = /vpc-routes
28482025-03-25T22:01:21.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44248
28492025-03-25T22:01:21.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44248 req_id = 9f45c96c-75b4-4f52-b1fe-808a04d9b97b response_code = 200 uri = /v2p
28502025-03-25T22:01:21.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62228
28512025-03-25T22:01:21.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28522025-03-25T22:01:21.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28532025-03-25T22:01:21.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62228 req_id = 8e9d4424-3830-411b-bd97-19584b9a3e3c response_code = 204 uri = /switch-ports
28542025-03-25T22:01:21.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42837
28552025-03-25T22:01:21.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47479
28562025-03-25T22:01:21.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62228 req_id = e7545ec2-49a7-462d-8c1e-69bd7149a7da response_code = 200 uri = /network-bootstore-config
28572025-03-25T22:01:21.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 553 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53932 req_id = 55e1dd43-84b9-463b-8d22-20f970a8ce98 response_code = 204 uri = /vpc-routes
28582025-03-25T22:01:21.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42837 req_id = 840f0080-485c-44b7-93e7-dd7c3a67b637 response_code = 200 uri = /v2p
28592025-03-25T22:01:21.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28602025-03-25T22:01:21.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28612025-03-25T22:01:21.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47479 req_id = a346a158-fb17-41cf-95b1-8b6c653372be response_code = 204 uri = /switch-ports
28622025-03-25T22:01:21.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47479 req_id = 47f975a5-f51f-4c7c-9698-1ac048e90fdf response_code = 200 uri = /network-bootstore-config
28632025-03-25T22:01:35.532ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46875
28642025-03-25T22:01:35.533ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46875 req_id = 18ef066f-696e-4cf6-b160-f6a437e3cbbd response_code = 200 uri = /baseboard
28652025-03-25T22:01:36.536ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
28662025-03-25T22:01:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
28672025-03-25T22:01:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
28682025-03-25T22:01:36.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
28692025-03-25T22:01:43.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7046 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = feaeaa92-6a18-4c39-9998-f083bc203d9e response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
28702025-03-25T22:01:51.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58084
28712025-03-25T22:01:51.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58084 req_id = 48d9522a-7fbb-43d1-8edb-b58bab45caf6 response_code = 200 uri = /vpc-routes
28722025-03-25T22:01:51.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42249
28732025-03-25T22:01:51.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42249 req_id = 6d1fe098-9c86-4c12-becf-3d01eeb267b9 response_code = 200 uri = /vpc-routes
28742025-03-25T22:01:51.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28752025-03-25T22:01:51.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58084 req_id = a8f634cb-1451-4de6-ac51-d25b082977a9 response_code = 204 uri = /eip-gateways
28762025-03-25T22:01:51.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58084 req_id = f87e8c79-9b9a-460a-a24f-89bceb267c9d response_code = 204 uri = /vpc-routes
28772025-03-25T22:01:51.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28782025-03-25T22:01:51.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42249 req_id = 3b1b1197-f211-487d-b091-bb8b812bc450 response_code = 204 uri = /eip-gateways
28792025-03-25T22:01:51.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39956
28802025-03-25T22:01:51.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28812025-03-25T22:01:51.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28822025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39956 req_id = 05756554-70a5-4d05-b29b-648ca7438209 response_code = 204 uri = /switch-ports
28832025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39448
28842025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56084
28852025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54226
28862025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60679
28872025-03-25T22:01:51.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39956 req_id = db0d8c33-e6ce-467d-a3b1-343218302f31 response_code = 200 uri = /network-bootstore-config
28882025-03-25T22:01:51.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
28892025-03-25T22:01:51.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56084 req_id = a59c0586-f841-4a3e-abf9-479b80d56ec1 response_code = 200 uri = /vpc-routes
28902025-03-25T22:01:51.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60679 req_id = e0609b46-17bc-4dc4-b783-c81973c384ee response_code = 200 uri = /v2p
28912025-03-25T22:01:51.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42249 req_id = 29b41693-ab3e-4891-acb0-3b111fec9f96 response_code = 204 uri = /vpc-routes
28922025-03-25T22:01:51.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54226 req_id = bc3d1527-5121-4697-8de6-2599134da060 response_code = 200 uri = /v2p
28932025-03-25T22:01:51.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
28942025-03-25T22:01:51.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56084 req_id = a4a29d1c-641e-4a15-b3d2-5b8599f78fb3 response_code = 204 uri = /eip-gateways
28952025-03-25T22:01:51.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 891 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56084 req_id = 6747f3f7-0d52-454a-8574-4e723c61618d response_code = 204 uri = /vpc-routes
28962025-03-25T22:01:51.332ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
28972025-03-25T22:01:51.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40961
28982025-03-25T22:01:51.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47769
28992025-03-25T22:01:51.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47769 req_id = 0b735571-3841-4ce5-baa8-29538f558560 response_code = 200 uri = /v2p
29002025-03-25T22:01:51.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29012025-03-25T22:01:51.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39448 req_id = e5d691d6-5a53-4d04-afde-4bbcb7291a2d response_code = 204 uri = /switch-ports
29022025-03-25T22:01:51.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39448 req_id = a593cb90-b43f-4bc5-8ad0-1dbe941c2efd response_code = 200 uri = /network-bootstore-config
29032025-03-25T22:01:51.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29042025-03-25T22:01:51.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40961 req_id = c1972d60-e56d-4b62-8601-b68b5f76db01 response_code = 204 uri = /switch-ports
29052025-03-25T22:01:51.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40961 req_id = 4324c86f-770c-429a-9029-6b9347c8555a response_code = 200 uri = /network-bootstore-config
29062025-03-25T22:02:05.565ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38095
29072025-03-25T22:02:05.565ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38095 req_id = 13afe3de-1575-48c2-a2cb-c110a6f7f6a6 response_code = 200 uri = /baseboard
29082025-03-25T22:02:13.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6700 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 49e4e677-a2f7-4984-a6e1-4c56ab58408d response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
29092025-03-25T22:02:21.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36626
29102025-03-25T22:02:21.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36626 req_id = a4f1ca46-9cf5-4a48-8ad4-38409d97c42b response_code = 200 uri = /vpc-routes
29112025-03-25T22:02:21.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29122025-03-25T22:02:21.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36626 req_id = 73300d1a-7bbd-4e39-b04d-ad9f69811c38 response_code = 204 uri = /eip-gateways
29132025-03-25T22:02:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51673
29142025-03-25T22:02:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51673 req_id = 2d29e9ba-ad6f-482a-b5b5-cf61797be41b response_code = 200 uri = /v2p
29152025-03-25T22:02:21.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36626 req_id = 25945b0c-9563-4518-99fa-cbb527f353ba response_code = 204 uri = /vpc-routes
29162025-03-25T22:02:21.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36828
29172025-03-25T22:02:21.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29182025-03-25T22:02:21.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29192025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36828 req_id = 5a506945-096e-4ed7-8d2b-e21bf53c3147 response_code = 204 uri = /switch-ports
29202025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57496
29212025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63392
29222025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63392 req_id = 097fe7e9-6984-407f-9db7-2c8aa287ef8e response_code = 200 uri = /vpc-routes
29232025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36828 req_id = 690ba8b3-b978-411f-93e9-a8aa01a967cf response_code = 200 uri = /network-bootstore-config
29242025-03-25T22:02:21.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57496 req_id = dc1c58fe-8f9c-4dfe-a330-271d17b16e46 response_code = 200 uri = /v2p
29252025-03-25T22:02:21.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41721
29262025-03-25T22:02:21.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41721 req_id = 7cd81d01-2b50-482d-8b54-42f6d7fecaab response_code = 200 uri = /vpc-routes
29272025-03-25T22:02:21.455ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29282025-03-25T22:02:21.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63392 req_id = d597d88d-1ed7-47a9-850a-fc87d1792084 response_code = 204 uri = /eip-gateways
29292025-03-25T22:02:21.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29302025-03-25T22:02:21.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41721 req_id = 8410fc1d-7b46-4fc3-a3e0-05398262a6ca response_code = 204 uri = /eip-gateways
29312025-03-25T22:02:21.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63392 req_id = f38f876c-af19-451d-b0d4-aee3b46c3c42 response_code = 204 uri = /vpc-routes
29322025-03-25T22:02:21.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32845
29332025-03-25T22:02:21.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32845 req_id = ea693c24-6bcd-4e7e-b9e1-90b0c0853a27 response_code = 200 uri = /v2p
29342025-03-25T22:02:21.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41721 req_id = 53c414fe-a599-4b2d-a30b-404b3d52acb3 response_code = 204 uri = /vpc-routes
29352025-03-25T22:02:21.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51614
29362025-03-25T22:02:21.569ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29372025-03-25T22:02:21.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29382025-03-25T22:02:21.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100834 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51614 req_id = eda79bff-6acd-4b1a-8e9b-b1f0e7194998 response_code = 204 uri = /switch-ports
29392025-03-25T22:02:21.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65308
29402025-03-25T22:02:21.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29412025-03-25T22:02:21.704ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29422025-03-25T22:02:21.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65308 req_id = 393d4ef4-3b9e-440f-beba-3cdda9d2741b response_code = 204 uri = /switch-ports
29432025-03-25T22:02:21.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65308 req_id = 81704c1e-d669-437e-9f4f-368563a2507c response_code = 200 uri = /network-bootstore-config
29442025-03-25T22:02:21.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51614 req_id = db256c3e-ca62-40da-bb8d-a5e947208abd response_code = 200 uri = /network-bootstore-config
29452025-03-25T22:02:35.600ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56531
29462025-03-25T22:02:35.600ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56531 req_id = d7c30c28-363d-4584-b174-849815fdc230 response_code = 200 uri = /baseboard
29472025-03-25T22:02:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
29482025-03-25T22:02:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
29492025-03-25T22:02:36.538ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
29502025-03-25T22:02:36.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
29512025-03-25T22:02:43.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6463 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 7805c705-dbcf-42a0-a162-70d9a245b0b9 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
29522025-03-25T22:02:51.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39117
29532025-03-25T22:02:51.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39117 req_id = f8228d26-0704-4303-ae2f-bc63a4a7135e response_code = 200 uri = /vpc-routes
29542025-03-25T22:02:51.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29552025-03-25T22:02:51.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39117 req_id = 816183b2-18ca-4ab8-84d7-f40e3dafdcd3 response_code = 204 uri = /eip-gateways
29562025-03-25T22:02:51.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39117 req_id = ace1c83e-4e03-4148-b136-3b0846fddbdb response_code = 204 uri = /vpc-routes
29572025-03-25T22:02:51.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61910
29582025-03-25T22:02:51.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61910 req_id = 33ce33e9-38dc-419f-a772-fc92dadf04b7 response_code = 200 uri = /v2p
29592025-03-25T22:02:51.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37965
29602025-03-25T22:02:51.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37965 req_id = 4d36d5b1-f1a0-4044-9522-90b2565b080a response_code = 200 uri = /vpc-routes
29612025-03-25T22:02:51.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29622025-03-25T22:02:51.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37965 req_id = aa476446-1b07-4caa-ae8d-0030a59058e7 response_code = 204 uri = /eip-gateways
29632025-03-25T22:02:51.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37965 req_id = 527b3606-763d-45c7-a960-4650fab29e17 response_code = 204 uri = /vpc-routes
29642025-03-25T22:02:51.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55011
29652025-03-25T22:02:51.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29662025-03-25T22:02:51.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29672025-03-25T22:02:51.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55011 req_id = d4aa60d8-8432-4eac-9bf6-60389ef5a3be response_code = 204 uri = /switch-ports
29682025-03-25T22:02:51.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53333
29692025-03-25T22:02:51.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37463
29702025-03-25T22:02:51.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37463 req_id = 01f1f12b-81f8-4673-a319-8cc8e24f504d response_code = 200 uri = /v2p
29712025-03-25T22:02:51.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55011 req_id = 7c5a37c0-365b-4f6f-82da-a1fa355219c7 response_code = 200 uri = /network-bootstore-config
29722025-03-25T22:02:51.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29732025-03-25T22:02:51.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44996
29742025-03-25T22:02:51.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44996 req_id = f783e6c7-f969-44c5-95ab-00e75da48f07 response_code = 200 uri = /vpc-routes
29752025-03-25T22:02:51.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29762025-03-25T22:02:51.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59864
29772025-03-25T22:02:51.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59864 req_id = 5036644d-db20-48f8-a852-063931c01ccc response_code = 200 uri = /v2p
29782025-03-25T22:02:51.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53333 req_id = f38d2a32-53da-45b0-a484-11ce50893654 response_code = 204 uri = /switch-ports
29792025-03-25T22:02:51.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53333 req_id = 8ecd3cd6-24a5-4ef3-bdd8-ae73ec62bbc8 response_code = 200 uri = /network-bootstore-config
29802025-03-25T22:02:51.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29812025-03-25T22:02:51.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44996 req_id = f099b7a6-5b6c-46af-9579-659913ea74ca response_code = 204 uri = /eip-gateways
29822025-03-25T22:02:51.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44996 req_id = 8e375294-19a0-4e0b-bf38-4bb97d207d0e response_code = 204 uri = /vpc-routes
29832025-03-25T22:02:51.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55599
29842025-03-25T22:02:51.366ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
29852025-03-25T22:02:51.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
29862025-03-25T22:02:51.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55599 req_id = a3cfee52-77d7-4071-90a2-fe0ccdb0e602 response_code = 204 uri = /switch-ports
29872025-03-25T22:02:51.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55599 req_id = ef7528cb-9365-4fbd-8104-215d9f21de79 response_code = 200 uri = /network-bootstore-config
29882025-03-25T22:03:05.634ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38971
29892025-03-25T22:03:05.634ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38971 req_id = b1d6d88a-6fe3-4799-9404-2e3983669032 response_code = 200 uri = /baseboard
29902025-03-25T22:03:13.583ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9597 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 80436895-6a45-431e-b847-d7bbdd00d530 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
29912025-03-25T22:03:21.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49469
29922025-03-25T22:03:21.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49469 req_id = 55fbcba4-929c-40b4-a3b5-b40295a9bb74 response_code = 200 uri = /vpc-routes
29932025-03-25T22:03:21.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47750
29942025-03-25T22:03:21.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47750 req_id = df7f3957-1e5b-469b-a25f-45cb713cd1b5 response_code = 200 uri = /vpc-routes
29952025-03-25T22:03:21.231ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29962025-03-25T22:03:21.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49469 req_id = 850835ca-5280-4858-b6e5-e4eb23a5d6a5 response_code = 204 uri = /eip-gateways
29972025-03-25T22:03:21.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49469 req_id = f06ba153-fb51-4171-a62a-faa51064f49f response_code = 204 uri = /vpc-routes
29982025-03-25T22:03:21.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
29992025-03-25T22:03:21.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47750 req_id = bb10b7ab-3eb4-4120-bf94-ca7132bd4daa response_code = 204 uri = /eip-gateways
30002025-03-25T22:03:21.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47750 req_id = 6245034e-08fd-4726-b1b6-ae851b4cc9ec response_code = 204 uri = /vpc-routes
30012025-03-25T22:03:21.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64048
30022025-03-25T22:03:21.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64048 req_id = 3583a68d-346e-43ff-90aa-3de0814e5eeb response_code = 200 uri = /v2p
30032025-03-25T22:03:21.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63256
30042025-03-25T22:03:21.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45598
30052025-03-25T22:03:21.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30062025-03-25T22:03:21.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39292
30072025-03-25T22:03:21.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39292 req_id = 8ac3d5a5-62a5-4de7-9684-d12b82475941 response_code = 200 uri = /vpc-routes
30082025-03-25T22:03:21.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30092025-03-25T22:03:21.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49551
30102025-03-25T22:03:21.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49551 req_id = 1f331e04-9b49-4795-855d-198218606730 response_code = 200 uri = /v2p
30112025-03-25T22:03:21.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30122025-03-25T22:03:21.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39292 req_id = ff32fbd8-c795-48a4-a190-e86615430f00 response_code = 204 uri = /eip-gateways
30132025-03-25T22:03:21.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39292 req_id = 039889b9-1a76-4324-becc-5f561e6bd067 response_code = 204 uri = /vpc-routes
30142025-03-25T22:03:21.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56891
30152025-03-25T22:03:21.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56891 req_id = 11dc259b-bab7-40de-adea-4c068164b96d response_code = 200 uri = /v2p
30162025-03-25T22:03:21.477ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30172025-03-25T22:03:21.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63256 req_id = 22feb3a8-113d-47ff-b033-c9673137f0cd response_code = 204 uri = /switch-ports
30182025-03-25T22:03:21.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63256 req_id = f10a1024-63cd-470a-ad77-4cd82c64945d response_code = 200 uri = /network-bootstore-config
30192025-03-25T22:03:21.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44531
30202025-03-25T22:03:21.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30212025-03-25T22:03:21.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30222025-03-25T22:03:21.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45598 req_id = 246f6ccc-887d-4f9e-81b4-471a6afe9049 response_code = 204 uri = /switch-ports
30232025-03-25T22:03:21.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45598 req_id = c8a863c0-d9c3-4df4-b9ef-1211072ba489 response_code = 200 uri = /network-bootstore-config
30242025-03-25T22:03:21.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30252025-03-25T22:03:21.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44531 req_id = ea1bf766-fba0-4354-913f-77d5e7d633bd response_code = 204 uri = /switch-ports
30262025-03-25T22:03:21.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44531 req_id = cae40716-b056-4d11-8040-fe72c9331093 response_code = 200 uri = /network-bootstore-config
30272025-03-25T22:03:35.668ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36325
30282025-03-25T22:03:35.668ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36325 req_id = 8c8e1de5-dd35-40f6-861f-452d44a66758 response_code = 200 uri = /baseboard
30292025-03-25T22:03:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
30302025-03-25T22:03:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
30312025-03-25T22:03:36.538ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
30322025-03-25T22:03:36.538ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
30332025-03-25T22:03:43.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7134 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 1ef1b0f7-6ca7-442d-906d-e901badd4cb7 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
30342025-03-25T22:03:51.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56251
30352025-03-25T22:03:51.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56251 req_id = a7b5c994-6d61-4290-a50a-e0fbb22a20e3 response_code = 200 uri = /vpc-routes
30362025-03-25T22:03:51.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42917
30372025-03-25T22:03:51.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42917 req_id = aadf00a1-e3ad-4b00-a61e-71fc5442d298 response_code = 200 uri = /vpc-routes
30382025-03-25T22:03:51.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36456
30392025-03-25T22:03:51.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36456 req_id = 04d1998a-3488-40fe-a578-48a879c10b2b response_code = 200 uri = /v2p
30402025-03-25T22:03:51.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47840
30412025-03-25T22:03:51.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30422025-03-25T22:03:51.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30432025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47840 req_id = 6908b8c7-f71f-4bbb-8d7a-69225419913d response_code = 204 uri = /switch-ports
30442025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34751
30452025-03-25T22:03:51.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30462025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56251 req_id = 60e6eb0d-ac9c-41c2-9edd-35034a83c47c response_code = 204 uri = /eip-gateways
30472025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60831
30482025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42038
30492025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50263
30502025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47840 req_id = 48128e0f-ad7c-458e-a7c5-e0f9783e2a80 response_code = 200 uri = /network-bootstore-config
30512025-03-25T22:03:51.314ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30522025-03-25T22:03:51.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30532025-03-25T22:03:51.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = 4dd04bc7-af47-423b-859f-8771d45f1186 response_code = 204 uri = /eip-gateways
30542025-03-25T22:03:51.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50263 req_id = ee914994-6894-4dfc-ac99-f287eeb248c8 response_code = 200 uri = /v2p
30552025-03-25T22:03:51.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60831 req_id = 51888b02-e3ea-41aa-8428-b848158edd80 response_code = 200 uri = /v2p
30562025-03-25T22:03:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4017 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42038 req_id = 494f0a54-22ac-4175-8e21-0208fd54e153 response_code = 200 uri = /vpc-routes
30572025-03-25T22:03:51.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = 8f045e81-e5ae-44b2-9a8b-1743ca3f383c response_code = 204 uri = /vpc-routes
30582025-03-25T22:03:51.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56251 req_id = 54c955e7-9e8a-4a96-8c88-12a55d838af5 response_code = 204 uri = /vpc-routes
30592025-03-25T22:03:51.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30602025-03-25T22:03:51.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42038 req_id = d38d4127-650f-497e-98f7-45207d6b490e response_code = 204 uri = /eip-gateways
30612025-03-25T22:03:51.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 472 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42038 req_id = ca9bf328-6509-4487-9d54-edcdc3d903c6 response_code = 204 uri = /vpc-routes
30622025-03-25T22:03:51.354ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30632025-03-25T22:03:51.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35089
30642025-03-25T22:03:51.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30652025-03-25T22:03:51.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34751 req_id = 1a0e4d5d-e17f-419f-b3d9-853688214ede response_code = 204 uri = /switch-ports
30662025-03-25T22:03:51.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34751 req_id = 9b3a7730-fd06-4dd0-8bf8-78264defe8c3 response_code = 200 uri = /network-bootstore-config
30672025-03-25T22:03:51.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30682025-03-25T22:03:51.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35089 req_id = a4b38ed6-12d2-47db-b035-2dbffbb94f27 response_code = 204 uri = /switch-ports
30692025-03-25T22:03:51.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35089 req_id = 53bec1f2-f09c-452c-a7d7-8f7a77cb250d response_code = 200 uri = /network-bootstore-config
30702025-03-25T22:04:05.701ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61029
30712025-03-25T22:04:05.701ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61029 req_id = 8fbe98d7-0e65-4e97-9baf-e2c81fbdf978 response_code = 200 uri = /baseboard
30722025-03-25T22:04:13.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6827 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = b3927554-d0f1-4063-8362-65803252eafb response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
30732025-03-25T22:04:21.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64351
30742025-03-25T22:04:21.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64351 req_id = 0488ddbf-974e-4bc2-a64e-15dc040f687e response_code = 200 uri = /vpc-routes
30752025-03-25T22:04:21.240ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30762025-03-25T22:04:21.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64351 req_id = 4eba9a45-5124-4f10-b938-9377b48a0a95 response_code = 204 uri = /eip-gateways
30772025-03-25T22:04:21.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64351 req_id = 59c4492b-0fc1-4dec-a3a6-31cf9f07d1d5 response_code = 204 uri = /vpc-routes
30782025-03-25T22:04:21.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53256
30792025-03-25T22:04:21.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53256 req_id = 7221a083-70d6-45dd-bcb6-81a867b12e38 response_code = 200 uri = /vpc-routes
30802025-03-25T22:04:21.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35308
30812025-03-25T22:04:21.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35308 req_id = a4acca45-1baf-42bd-8b63-a45c598321c4 response_code = 200 uri = /vpc-routes
30822025-03-25T22:04:21.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30832025-03-25T22:04:21.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35308 req_id = 5e99b34e-2d8a-4e20-b7bd-00fb2d7dc7ac response_code = 204 uri = /eip-gateways
30842025-03-25T22:04:21.382ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
30852025-03-25T22:04:21.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53256 req_id = cd37bf3e-f385-4224-8e60-562ccf99fba4 response_code = 204 uri = /eip-gateways
30862025-03-25T22:04:21.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35308 req_id = e4f7c6b1-7aab-4df4-8e5b-964b667107c9 response_code = 204 uri = /vpc-routes
30872025-03-25T22:04:21.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53256 req_id = 476091ce-9438-4161-8f52-99df4bdfe3ec response_code = 204 uri = /vpc-routes
30882025-03-25T22:04:21.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47931
30892025-03-25T22:04:21.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30902025-03-25T22:04:21.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
30912025-03-25T22:04:21.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103935 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47931 req_id = 2c6ae20f-ff41-44bd-aadd-18aa6a63eb09 response_code = 204 uri = /switch-ports
30922025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63459
30932025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37390
30942025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37797
30952025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40566
30962025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63459 req_id = 528fd52c-1b31-4eb9-96f5-471b14f50172 response_code = 200 uri = /v2p
30972025-03-25T22:04:21.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
30982025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47931 req_id = ac138e39-76a3-4474-8028-4048e3542f66 response_code = 200 uri = /network-bootstore-config
30992025-03-25T22:04:21.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37390 req_id = 8c07927d-1ecb-4c97-8e5c-88aa98bf5751 response_code = 200 uri = /v2p
31002025-03-25T22:04:21.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55107
31012025-03-25T22:04:21.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55107 req_id = 634152b6-ffd9-418f-8588-4da0f54538ed response_code = 200 uri = /v2p
31022025-03-25T22:04:21.563ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31032025-03-25T22:04:21.619ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31042025-03-25T22:04:21.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37797 req_id = 4e39d57c-5c1f-41ed-a558-7daaaaf32055 response_code = 204 uri = /switch-ports
31052025-03-25T22:04:21.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 637 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37797 req_id = d1017a7a-3046-4cd4-a57c-326a439fc840 response_code = 200 uri = /network-bootstore-config
31062025-03-25T22:04:21.656ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31072025-03-25T22:04:21.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40566 req_id = e50c26e5-6f09-415c-b26f-471989b77fdc response_code = 204 uri = /switch-ports
31082025-03-25T22:04:21.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40566 req_id = 15e36515-83c2-4bcb-b939-7ee6f56744fe response_code = 200 uri = /network-bootstore-config
31092025-03-25T22:04:32.983ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
31102025-03-25T22:04:35.732ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49840
31112025-03-25T22:04:35.732ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49840 req_id = d497ae8c-18a3-4da0-90c6-929091ec2612 response_code = 200 uri = /baseboard
31122025-03-25T22:04:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
31132025-03-25T22:04:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
31142025-03-25T22:04:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
31152025-03-25T22:04:36.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
31162025-03-25T22:04:43.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6203 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 182d9240-b0f5-44fb-ab94-d8cfb7c3def4 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
31172025-03-25T22:04:51.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61214
31182025-03-25T22:04:51.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61214 req_id = 89f7f6cb-6582-4fa9-898e-af53395f9c96 response_code = 200 uri = /vpc-routes
31192025-03-25T22:04:51.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63799
31202025-03-25T22:04:51.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63799 req_id = 330e7409-0650-4561-82ec-f29f4053407d response_code = 200 uri = /vpc-routes
31212025-03-25T22:04:51.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
31222025-03-25T22:04:51.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61214 req_id = a4026b95-63f1-4902-9754-9273af68d1b4 response_code = 204 uri = /eip-gateways
31232025-03-25T22:04:51.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61214 req_id = ac52a965-8bdf-42c8-8a11-73711a32c5eb response_code = 204 uri = /vpc-routes
31242025-03-25T22:04:51.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44057
31252025-03-25T22:04:51.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31262025-03-25T22:04:51.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31272025-03-25T22:04:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44057 req_id = 11cd471c-4c3f-4d11-a02f-60d41b3b41f0 response_code = 204 uri = /switch-ports
31282025-03-25T22:04:51.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52762
31292025-03-25T22:04:51.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55365
31302025-03-25T22:04:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44057 req_id = 4e779595-8661-42a6-93ca-465d91033f94 response_code = 200 uri = /network-bootstore-config
31312025-03-25T22:04:51.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31322025-03-25T22:04:51.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
31332025-03-25T22:04:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63799 req_id = 283c6dc8-996a-471c-8842-885815af2586 response_code = 204 uri = /eip-gateways
31342025-03-25T22:04:51.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55365 req_id = 40a05fe0-dcbf-4f44-b9cd-a1ebfe8e628d response_code = 200 uri = /v2p
31352025-03-25T22:04:51.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65260
31362025-03-25T22:04:51.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65260 req_id = 5cfa83a6-6fc4-45b6-ae1d-98045fee103c response_code = 200 uri = /v2p
31372025-03-25T22:04:51.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36161
31382025-03-25T22:04:51.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36161 req_id = 51f68127-12db-448d-bf55-405fbce0ffc2 response_code = 200 uri = /vpc-routes
31392025-03-25T22:04:51.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63799 req_id = 755debb7-6383-4056-b0fb-fe69a35b19b1 response_code = 204 uri = /vpc-routes
31402025-03-25T22:04:51.318ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31412025-03-25T22:04:51.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41587
31422025-03-25T22:04:51.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41587 req_id = 592fc310-c9bf-4b4e-b2bd-b769e8a033a0 response_code = 200 uri = /v2p
31432025-03-25T22:04:51.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39495
31442025-03-25T22:04:51.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
31452025-03-25T22:04:51.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36161 req_id = b1cb1e6a-b524-4b3f-a5fa-cc74037851ba response_code = 204 uri = /eip-gateways
31462025-03-25T22:04:51.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36161 req_id = 21106496-ed61-4c0b-bb66-ba0c1534bf12 response_code = 204 uri = /vpc-routes
31472025-03-25T22:04:51.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31482025-03-25T22:04:51.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52762 req_id = 35b45098-d1f0-40a2-8408-ac1686e50e8c response_code = 204 uri = /switch-ports
31492025-03-25T22:04:51.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52762 req_id = 55c40ae0-92d9-46b7-bc06-735224fa6ffa response_code = 200 uri = /network-bootstore-config
31502025-03-25T22:04:51.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31512025-03-25T22:04:51.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39495 req_id = 8cb9b184-0620-49e9-be28-199a43d24018 response_code = 204 uri = /switch-ports
31522025-03-25T22:04:51.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39495 req_id = 359cfc04-27cd-49ce-af2a-c6466963bccd response_code = 200 uri = /network-bootstore-config
31532025-03-25T22:05:05.765ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33004
31542025-03-25T22:05:05.765ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33004 req_id = 8f9d0bcf-4be8-426e-8aa4-00c1936f1d2c response_code = 200 uri = /baseboard
31552025-03-25T22:05:13.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6305 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 15824d3d-c64d-4979-8662-258e96e47af9 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
31562025-03-25T22:05:21.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45843
31572025-03-25T22:05:21.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45843 req_id = 313d8c96-3765-40d9-93c0-31d8e26d5009 response_code = 200 uri = /vpc-routes
31582025-03-25T22:05:21.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64793
31592025-03-25T22:05:21.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64793 req_id = 8d180f11-fa32-41ca-a506-865165ecef6d response_code = 200 uri = /vpc-routes
31602025-03-25T22:05:21.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
31612025-03-25T22:05:21.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45843 req_id = e9fe105b-99c0-4eba-ba0d-907cd0df126d response_code = 204 uri = /eip-gateways
31622025-03-25T22:05:21.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
31632025-03-25T22:05:21.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64793 req_id = 120b9cf5-0acb-4464-9283-fefff6dd8c6a response_code = 204 uri = /eip-gateways
31642025-03-25T22:05:21.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45843 req_id = 9394c53e-bb36-48c8-8ba3-746b22b3a641 response_code = 204 uri = /vpc-routes
31652025-03-25T22:05:21.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51531
31662025-03-25T22:05:21.426ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
31672025-03-25T22:05:21.426ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
31682025-03-25T22:05:21.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51531 req_id = 1d3ead59-9fb8-428b-a50a-788518d4cd51 response_code = 204 uri = /artifacts-config
31692025-03-25T22:05:21.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31702025-03-25T22:05:21.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51531 req_id = e8dd6f53-2f9c-47dd-9f63-0492d691d8d0 response_code = 200 uri = /artifacts
31712025-03-25T22:05:21.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60278
31722025-03-25T22:05:21.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31732025-03-25T22:05:21.509ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
31742025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60278 req_id = a9ffd923-49a3-4928-9cc1-7fe992a62fbe response_code = 204 uri = /switch-ports
31752025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64578
31762025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38425
31772025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35154
31782025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36445
31792025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60278 req_id = 8a1b51d1-b4da-4167-8c98-ba3dfe82ed6b response_code = 200 uri = /network-bootstore-config
31802025-03-25T22:05:21.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64793 req_id = 36ecd1de-c762-4d17-9c24-9af9a70ae7b9 response_code = 204 uri = /vpc-routes
31812025-03-25T22:05:21.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64578 req_id = d8f505d3-27dd-4b82-b8d1-d1b935939ae1 response_code = 200 uri = /v2p
31822025-03-25T22:05:21.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
31832025-03-25T22:05:21.585ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
31842025-03-25T22:05:21.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38425 req_id = 69e651b6-ba2c-4b5c-8569-f0f4093757ba response_code = 200 uri = /v2p
31852025-03-25T22:05:21.585ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
31862025-03-25T22:05:21.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5664 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35154 req_id = 0d648cd1-ff9a-42d1-97ca-bb10c7d42f2a response_code = 204 uri = /artifacts-config
31872025-03-25T22:05:21.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31882025-03-25T22:05:21.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35154 req_id = 97e0e8ef-19cf-4dc0-a0ed-96573554f738 response_code = 200 uri = /artifacts
31892025-03-25T22:05:21.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65111
31902025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
31912025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31922025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31932025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31942025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
31952025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
31962025-03-25T22:05:21.604ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
31972025-03-25T22:05:21.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65111 req_id = 7f55dcf6-cab8-4f01-a337-d5fa6191168d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
31982025-03-25T22:05:21.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47613
31992025-03-25T22:05:21.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47613 req_id = 18c948c6-37a4-462d-a175-8b85fcae80a4 response_code = 200 uri = /vpc-routes
32002025-03-25T22:05:21.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32012025-03-25T22:05:21.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32022025-03-25T22:05:21.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47613 req_id = 9c06877d-6672-4a91-b861-abba98da247f response_code = 204 uri = /eip-gateways
32032025-03-25T22:05:21.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47613 req_id = e7e07689-edaf-43df-818a-5461d4405910 response_code = 204 uri = /vpc-routes
32042025-03-25T22:05:21.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47058
32052025-03-25T22:05:21.698ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
32062025-03-25T22:05:21.698ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
32072025-03-25T22:05:21.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47058 req_id = e7b85188-4d8a-414f-9d8f-751bb5019244 response_code = 204 uri = /artifacts-config
32082025-03-25T22:05:21.698ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32092025-03-25T22:05:21.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47058 req_id = 0a1f517a-667a-46f6-94ef-680d31e0482d response_code = 200 uri = /artifacts
32102025-03-25T22:05:21.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122571 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36445 req_id = 01a95596-b303-46ff-a576-18c93ce96b74 response_code = 204 uri = /switch-ports
32112025-03-25T22:05:21.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36445 req_id = f282626d-121a-46ad-9b86-d69d63560334 response_code = 200 uri = /network-bootstore-config
32122025-03-25T22:05:21.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53081
32132025-03-25T22:05:21.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32142025-03-25T22:05:21.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32152025-03-25T22:05:21.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53081 req_id = 2d3a41bd-5339-490c-8349-783681401359 response_code = 204 uri = /switch-ports
32162025-03-25T22:05:21.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61015
32172025-03-25T22:05:21.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58276
32182025-03-25T22:05:21.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58276 req_id = f9ccd27e-c495-4826-bbe1-3e56d07285fb response_code = 200 uri = /v2p
32192025-03-25T22:05:21.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53081 req_id = ec6afd9c-06de-4a77-96c4-5e242b056c13 response_code = 200 uri = /network-bootstore-config
32202025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
32212025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32222025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32232025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32242025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32252025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
32262025-03-25T22:05:21.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32272025-03-25T22:05:21.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61015 req_id = f53feb08-2bda-4546-b6a8-198a3bfddd45 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32282025-03-25T22:05:21.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45149
32292025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
32302025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32312025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32322025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32332025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
32342025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
32352025-03-25T22:05:21.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
32362025-03-25T22:05:21.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45149 req_id = 224baa87-eda9-4553-887c-2e8d93af8125 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32372025-03-25T22:05:35.802ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59482
32382025-03-25T22:05:35.802ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59482 req_id = 162b505a-068e-4929-9472-b2830aec32f0 response_code = 200 uri = /baseboard
32392025-03-25T22:05:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
32402025-03-25T22:05:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
32412025-03-25T22:05:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
32422025-03-25T22:05:36.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
32432025-03-25T22:05:43.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6702 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 46b0d9d6-022c-4c7e-943e-2a382c18f52f response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
32442025-03-25T22:05:51.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58962
32452025-03-25T22:05:51.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58962 req_id = 4cbc3129-b250-4de6-974a-0dc7c40507f2 response_code = 200 uri = /vpc-routes
32462025-03-25T22:05:51.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43630
32472025-03-25T22:05:51.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43630 req_id = cd076906-2d37-4705-b62e-ee1187cf7f29 response_code = 200 uri = /vpc-routes
32482025-03-25T22:05:51.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32492025-03-25T22:05:51.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43630 req_id = d7f96a18-b368-4aff-8b7d-df956f198459 response_code = 204 uri = /eip-gateways
32502025-03-25T22:05:51.184ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32512025-03-25T22:05:51.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58962 req_id = 7b0be2bf-7ea0-4815-b05b-c96ea30032a0 response_code = 204 uri = /eip-gateways
32522025-03-25T22:05:51.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58962 req_id = 1ebfe375-8278-47b6-9217-709d7950ac8e response_code = 204 uri = /vpc-routes
32532025-03-25T22:05:51.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34559
32542025-03-25T22:05:51.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34559 req_id = ac6dd3a1-e5e6-4052-9bf4-e80ee1459bd5 response_code = 200 uri = /v2p
32552025-03-25T22:05:51.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43630 req_id = dc69a4c2-9d91-418f-bbd4-c3af817518e6 response_code = 204 uri = /vpc-routes
32562025-03-25T22:05:51.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34223
32572025-03-25T22:05:51.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32582025-03-25T22:05:51.262ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32592025-03-25T22:05:51.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34223 req_id = 16eca16c-2d84-424b-b7fd-95e4f4c76c29 response_code = 204 uri = /switch-ports
32602025-03-25T22:05:51.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38884
32612025-03-25T22:05:51.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33140
32622025-03-25T22:05:51.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32632025-03-25T22:05:51.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34223 req_id = e251109a-039e-45af-bef8-eacd7df0275d response_code = 200 uri = /network-bootstore-config
32642025-03-25T22:05:51.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38884 req_id = 33cc351d-722a-4611-b901-09b1a832e2f5 response_code = 200 uri = /vpc-routes
32652025-03-25T22:05:51.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42965
32662025-03-25T22:05:51.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60825
32672025-03-25T22:05:51.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60825 req_id = 26073939-e8e6-4b48-8686-d6ef442fce36 response_code = 200 uri = /v2p
32682025-03-25T22:05:51.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32692025-03-25T22:05:51.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32702025-03-25T22:05:51.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38884 req_id = 68ce804d-abbd-4e08-b1e0-f36de22ee43f response_code = 204 uri = /eip-gateways
32712025-03-25T22:05:51.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38884 req_id = 6dbe128c-239d-4737-8338-2814c0545082 response_code = 204 uri = /vpc-routes
32722025-03-25T22:05:51.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54330
32732025-03-25T22:05:51.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54330 req_id = 5d3ee96f-c37b-49a6-9495-ff15e2cd5533 response_code = 200 uri = /v2p
32742025-03-25T22:05:51.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32752025-03-25T22:05:51.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33140 req_id = dd9d2b35-7805-40f7-bd80-4330ebe6fc26 response_code = 204 uri = /switch-ports
32762025-03-25T22:05:51.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33140 req_id = 400ae692-3431-464a-afeb-f75c17a2d9b6 response_code = 200 uri = /network-bootstore-config
32772025-03-25T22:05:51.465ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
32782025-03-25T22:05:51.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42965 req_id = 170384d5-4bed-4376-8195-195295b66821 response_code = 204 uri = /switch-ports
32792025-03-25T22:05:51.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42965 req_id = f71125fe-32c3-4753-a019-b7d758674b27 response_code = 200 uri = /network-bootstore-config
32802025-03-25T22:06:05.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52774
32812025-03-25T22:06:05.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52774 req_id = 47a7d89b-8d74-4915-ae92-1c19d8c29bda response_code = 200 uri = /baseboard
32822025-03-25T22:06:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7309 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = f44adb9f-17aa-41be-a39e-880d7ba857c8 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
32832025-03-25T22:06:21.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58631
32842025-03-25T22:06:21.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58631 req_id = e72e9db0-6438-492b-8f7a-a0a16a4ec0f8 response_code = 200 uri = /vpc-routes
32852025-03-25T22:06:21.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32862025-03-25T22:06:21.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58631 req_id = ef60bc62-e973-493e-b032-6e95732dea2a response_code = 204 uri = /eip-gateways
32872025-03-25T22:06:21.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58631 req_id = cee91ede-b867-4a11-a273-a73a01e15c0d response_code = 204 uri = /vpc-routes
32882025-03-25T22:06:21.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42258
32892025-03-25T22:06:21.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42258 req_id = 4bce91a0-6eb2-4493-a589-481a6247a47d response_code = 200 uri = /vpc-routes
32902025-03-25T22:06:21.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39230
32912025-03-25T22:06:21.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39230 req_id = d553b945-ae97-4c0c-9d16-aea1111a01fb response_code = 200 uri = /v2p
32922025-03-25T22:06:21.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39042
32932025-03-25T22:06:21.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39042 req_id = f4acf298-0dcd-4967-8faa-b8e31627a905 response_code = 200 uri = /v2p
32942025-03-25T22:06:21.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
32952025-03-25T22:06:21.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42258 req_id = fba39e5b-7d9d-4490-a506-1a30df356bf1 response_code = 204 uri = /eip-gateways
32962025-03-25T22:06:21.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42258 req_id = af54707a-428b-49ca-83d2-1ae98a9c1df6 response_code = 204 uri = /vpc-routes
32972025-03-25T22:06:21.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38342
32982025-03-25T22:06:21.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
32992025-03-25T22:06:21.452ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33002025-03-25T22:06:21.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38342 req_id = ae1faafe-058d-4ca6-bbba-543319b0b839 response_code = 204 uri = /switch-ports
33012025-03-25T22:06:21.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37434
33022025-03-25T22:06:21.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52786
33032025-03-25T22:06:21.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50368
33042025-03-25T22:06:21.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33052025-03-25T22:06:21.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37434 req_id = 398e3551-fb7e-4050-9941-568ddfb109ba response_code = 200 uri = /vpc-routes
33062025-03-25T22:06:21.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38342 req_id = 196b5f2d-24fe-43e4-8b63-341b1fa792e5 response_code = 200 uri = /network-bootstore-config
33072025-03-25T22:06:21.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33082025-03-25T22:06:21.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33092025-03-25T22:06:21.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37434 req_id = 36e2e05e-254d-4007-abe1-6194395a0eb4 response_code = 204 uri = /eip-gateways
33102025-03-25T22:06:21.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37434 req_id = b3089123-85b7-4f85-9c1e-34c51e276db0 response_code = 204 uri = /vpc-routes
33112025-03-25T22:06:21.646ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33122025-03-25T22:06:21.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50368 req_id = 94e26956-d37c-45d9-bce0-0e2a5c3f389e response_code = 204 uri = /switch-ports
33132025-03-25T22:06:21.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50368 req_id = 7b0a750d-d07e-4c0d-b459-39ef8e2b5091 response_code = 200 uri = /network-bootstore-config
33142025-03-25T22:06:21.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63131
33152025-03-25T22:06:21.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63131 req_id = 3014fa67-e3cb-468b-8b6b-06ad92a6f37c response_code = 200 uri = /v2p
33162025-03-25T22:06:21.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33172025-03-25T22:06:21.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52786 req_id = 43f920bd-0eda-421f-8def-ca32b9967600 response_code = 204 uri = /switch-ports
33182025-03-25T22:06:21.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52786 req_id = d677be4b-c91d-42f0-b7b8-5817674cd6bf response_code = 200 uri = /network-bootstore-config
33192025-03-25T22:06:35.870ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35603
33202025-03-25T22:06:35.870ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35603 req_id = a2fffc8e-ca1b-46cd-90d7-7bf85b27b917 response_code = 200 uri = /baseboard
33212025-03-25T22:06:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
33222025-03-25T22:06:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
33232025-03-25T22:06:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
33242025-03-25T22:06:36.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
33252025-03-25T22:06:37.634ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:212
33262025-03-25T22:06:37.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
33272025-03-25T22:06:37.665ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 7151, tv_nsec: 881240 } time_to_next_cleanup = 599.99999601s
33282025-03-25T22:06:43.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7360 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 5aa28ed2-4958-49b4-ae57-796dd80bd693 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
33292025-03-25T22:06:51.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63712
33302025-03-25T22:06:51.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63712 req_id = 5ee15acb-a035-49bc-9544-c787bf507421 response_code = 200 uri = /v2p
33312025-03-25T22:06:51.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56475
33322025-03-25T22:06:51.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56475 req_id = 1d12755f-8857-47bc-ae06-613bd4111e72 response_code = 200 uri = /vpc-routes
33332025-03-25T22:06:51.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56379
33342025-03-25T22:06:51.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56379 req_id = 371bda80-f27c-4860-a8d6-8365175162ac response_code = 200 uri = /vpc-routes
33352025-03-25T22:06:51.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33362025-03-25T22:06:51.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56475 req_id = db090d17-df9a-4c57-a53f-ce8aa9cc03ad response_code = 204 uri = /eip-gateways
33372025-03-25T22:06:51.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33382025-03-25T22:06:51.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56379 req_id = fdeb0e5f-e34f-4585-86bb-c757bd6ab2f4 response_code = 204 uri = /eip-gateways
33392025-03-25T22:06:51.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56475 req_id = cf06baf8-68fa-4f1b-83fe-b8af1ff6ba2b response_code = 204 uri = /vpc-routes
33402025-03-25T22:06:51.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56379 req_id = 3ed44d1a-a2ad-47cc-b9e7-1d01482925d5 response_code = 204 uri = /vpc-routes
33412025-03-25T22:06:51.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43732
33422025-03-25T22:06:51.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43732 req_id = 2cdd139d-c509-4a87-b862-2d2c2a454738 response_code = 200 uri = /v2p
33432025-03-25T22:06:51.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51426
33442025-03-25T22:06:51.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33452025-03-25T22:06:51.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33462025-03-25T22:06:51.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51426 req_id = 36926f97-05f4-4ab6-854b-25d7593f4767 response_code = 204 uri = /switch-ports
33472025-03-25T22:06:51.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37565
33482025-03-25T22:06:51.298ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33492025-03-25T22:06:51.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33502025-03-25T22:06:51.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37565 req_id = 6c48c015-d042-484b-aad8-776e1aea825d response_code = 204 uri = /switch-ports
33512025-03-25T22:06:51.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45728
33522025-03-25T22:06:51.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64243
33532025-03-25T22:06:51.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51426 req_id = 2e1176a4-53f4-4685-b0e0-39a1de7088f0 response_code = 200 uri = /network-bootstore-config
33542025-03-25T22:06:51.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37565 req_id = 03687260-0409-4ac8-9b48-011f21f8619a response_code = 200 uri = /network-bootstore-config
33552025-03-25T22:06:51.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45728 req_id = 65956fbb-5e69-42bf-bd26-e2a8e204081a response_code = 200 uri = /vpc-routes
33562025-03-25T22:06:51.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64243 req_id = a470b186-ce1e-494a-a90c-6e44789c0259 response_code = 200 uri = /v2p
33572025-03-25T22:06:51.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36225
33582025-03-25T22:06:51.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33592025-03-25T22:06:51.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33602025-03-25T22:06:51.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36225 req_id = 9dce0e70-5348-43b7-a8c8-f0d495acc739 response_code = 204 uri = /switch-ports
33612025-03-25T22:06:51.515ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33622025-03-25T22:06:51.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45728 req_id = 30b01bb6-c822-4957-a102-6a811b9cacba response_code = 204 uri = /eip-gateways
33632025-03-25T22:06:51.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36225 req_id = 9a40749f-bb1f-4f95-a175-63719af24f9e response_code = 200 uri = /network-bootstore-config
33642025-03-25T22:06:51.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45728 req_id = 1f6e83fd-8bc7-4f80-8664-f0a976e2a147 response_code = 204 uri = /vpc-routes
33652025-03-25T22:07:05.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55369
33662025-03-25T22:07:05.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55369 req_id = 8e989c1d-c4d9-4b9d-9095-66e9a77a2a4d response_code = 200 uri = /baseboard
33672025-03-25T22:07:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6666 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = e5a53432-a601-4c44-b16a-aa4b31f81c57 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
33682025-03-25T22:07:21.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56810
33692025-03-25T22:07:21.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56810 req_id = a8422a06-76f3-45c3-9343-55a83bc6d2e0 response_code = 200 uri = /vpc-routes
33702025-03-25T22:07:21.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33712025-03-25T22:07:21.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56810 req_id = 8ac044b7-889a-436a-a5ba-ff89ddd156a4 response_code = 204 uri = /eip-gateways
33722025-03-25T22:07:21.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51408
33732025-03-25T22:07:21.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51408 req_id = b89ff208-589e-4cab-94e5-d5f97cdcbabd response_code = 200 uri = /vpc-routes
33742025-03-25T22:07:21.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39947
33752025-03-25T22:07:21.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39947 req_id = f90fd648-92c0-4edc-aae1-ca1f77d8e44b response_code = 200 uri = /v2p
33762025-03-25T22:07:21.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33772025-03-25T22:07:21.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51408 req_id = 31d9f539-bb09-4bda-a08a-bcfc7f6df1fe response_code = 204 uri = /eip-gateways
33782025-03-25T22:07:21.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56810 req_id = d489609b-e6b0-42f1-8684-b246f16a3972 response_code = 204 uri = /vpc-routes
33792025-03-25T22:07:21.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51408 req_id = 175c65d5-5381-4a19-9e88-62834ff98878 response_code = 204 uri = /vpc-routes
33802025-03-25T22:07:21.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42106
33812025-03-25T22:07:21.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42106 req_id = 59848782-8dc5-416c-9c73-1a5f304ead3f response_code = 200 uri = /vpc-routes
33822025-03-25T22:07:21.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34545
33832025-03-25T22:07:21.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33842025-03-25T22:07:21.428ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33852025-03-25T22:07:21.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34545 req_id = 9592b7ac-3056-47f1-b4e6-50c686e9323d response_code = 204 uri = /switch-ports
33862025-03-25T22:07:21.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33470
33872025-03-25T22:07:21.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
33882025-03-25T22:07:21.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42106 req_id = e3d3cc39-d81d-4155-946b-31f2e75d7190 response_code = 204 uri = /eip-gateways
33892025-03-25T22:07:21.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34545 req_id = 92c12b92-8e35-463a-9324-a998077116de response_code = 200 uri = /network-bootstore-config
33902025-03-25T22:07:21.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33470 req_id = bffcfd7e-8fb9-4af0-b837-5b8cdade62ac response_code = 200 uri = /v2p
33912025-03-25T22:07:21.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42106 req_id = dd652aee-70d0-4f23-9bf0-3ed63422ec98 response_code = 204 uri = /vpc-routes
33922025-03-25T22:07:21.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43535
33932025-03-25T22:07:21.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33942025-03-25T22:07:21.550ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
33952025-03-25T22:07:21.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43535 req_id = ce651a69-b1c0-416f-9e56-7fe2c7e22f02 response_code = 204 uri = /switch-ports
33962025-03-25T22:07:21.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63867
33972025-03-25T22:07:21.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34870
33982025-03-25T22:07:21.606ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
33992025-03-25T22:07:21.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43535 req_id = e29a6d75-e4bf-4750-94fc-b3c10ff48f0d response_code = 200 uri = /network-bootstore-config
34002025-03-25T22:07:21.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34870 req_id = 7a8dfddc-6ab4-4cda-8794-cc60f76f66a2 response_code = 200 uri = /v2p
34012025-03-25T22:07:21.641ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34022025-03-25T22:07:21.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63867 req_id = 9fca2c6c-fba9-416b-a4fd-4128d70f4c2d response_code = 204 uri = /switch-ports
34032025-03-25T22:07:21.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63867 req_id = c64c6c59-105a-4085-8bd3-b9cd1f149889 response_code = 200 uri = /network-bootstore-config
34042025-03-25T22:07:35.937ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48336
34052025-03-25T22:07:35.937ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48336 req_id = d96a9c89-8ee4-46a5-bfa1-cb23cf393eb2 response_code = 200 uri = /baseboard
34062025-03-25T22:07:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
34072025-03-25T22:07:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
34082025-03-25T22:07:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
34092025-03-25T22:07:36.540ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
34102025-03-25T22:07:43.582ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7260 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 1b57cf16-3ee9-4f53-b03d-83e6a6fecccc response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
34112025-03-25T22:07:51.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45799
34122025-03-25T22:07:51.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45799 req_id = f6862271-84cf-4754-8b2e-619665c3d3ec response_code = 200 uri = /vpc-routes
34132025-03-25T22:07:51.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40733
34142025-03-25T22:07:51.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40733 req_id = 1a8f472f-1f68-4f2f-aaf0-e4c817750357 response_code = 200 uri = /vpc-routes
34152025-03-25T22:07:51.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34162025-03-25T22:07:51.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45799 req_id = a78c5466-6bd4-4a63-abd9-bb2200d021d9 response_code = 204 uri = /eip-gateways
34172025-03-25T22:07:51.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45799 req_id = 6c19ff14-5dda-4330-bfdb-7ef67938fb99 response_code = 204 uri = /vpc-routes
34182025-03-25T22:07:51.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34192025-03-25T22:07:51.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40733 req_id = 5e3c2df5-e5bf-45de-8f06-55656cffd0df response_code = 204 uri = /eip-gateways
34202025-03-25T22:07:51.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40733 req_id = 9bfeed7c-28e9-47b3-a9f2-6d0e5c744fb5 response_code = 204 uri = /vpc-routes
34212025-03-25T22:07:51.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57230
34222025-03-25T22:07:51.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57230 req_id = f28d8950-4be4-45ab-875f-9527e31a82e7 response_code = 200 uri = /v2p
34232025-03-25T22:07:51.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49413
34242025-03-25T22:07:51.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49413 req_id = f53f1055-d180-4b62-a3dc-9f2936fbe53e response_code = 200 uri = /v2p
34252025-03-25T22:07:51.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37350
34262025-03-25T22:07:51.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34272025-03-25T22:07:51.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34282025-03-25T22:07:51.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37350 req_id = 259a3ad4-39ca-4cbd-aff2-123292c22340 response_code = 204 uri = /switch-ports
34292025-03-25T22:07:51.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44070
34302025-03-25T22:07:51.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56391
34312025-03-25T22:07:51.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34322025-03-25T22:07:51.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37350 req_id = f4f16321-f74d-4468-8f3d-740564e7c36f response_code = 200 uri = /network-bootstore-config
34332025-03-25T22:07:51.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44070 req_id = f74e44eb-3901-408f-92f7-be8447a79b08 response_code = 200 uri = /vpc-routes
34342025-03-25T22:07:51.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44950
34352025-03-25T22:07:51.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44950 req_id = 556fe524-afab-4b80-b4fb-421008185b55 response_code = 200 uri = /v2p
34362025-03-25T22:07:51.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34372025-03-25T22:07:51.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34382025-03-25T22:07:51.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44070 req_id = f0f1a332-290d-4ebd-a108-ca8c60661f80 response_code = 204 uri = /eip-gateways
34392025-03-25T22:07:51.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 994 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44070 req_id = f68a3002-4fc4-40fe-8626-5a4ae37de2db response_code = 204 uri = /vpc-routes
34402025-03-25T22:07:51.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52147
34412025-03-25T22:07:51.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34422025-03-25T22:07:51.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56391 req_id = e1b3671f-db0e-4891-8df6-6acd3c62cf26 response_code = 204 uri = /switch-ports
34432025-03-25T22:07:51.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56391 req_id = 6f58a1d6-a0a9-47a7-a60f-a36bc62b56d4 response_code = 200 uri = /network-bootstore-config
34442025-03-25T22:07:51.574ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34452025-03-25T22:07:51.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52147 req_id = bfae0250-0f5b-4f69-810d-3ef0491e7729 response_code = 204 uri = /switch-ports
34462025-03-25T22:07:51.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52147 req_id = 5b58d06f-2196-4d75-90c4-ed862c9a9923 response_code = 200 uri = /network-bootstore-config
34472025-03-25T22:08:05.970ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32815
34482025-03-25T22:08:05.970ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32815 req_id = cf589df1-fb8d-41a5-aa67-a43fc3ce969a response_code = 200 uri = /baseboard
34492025-03-25T22:08:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6171 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 3ce05dea-8cfe-4fa3-96fd-c0c967347e63 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
34502025-03-25T22:08:21.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33339
34512025-03-25T22:08:21.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33339 req_id = adacd1a6-2823-40a1-8272-ffe1d9d9a3a3 response_code = 200 uri = /vpc-routes
34522025-03-25T22:08:21.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39061
34532025-03-25T22:08:21.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39061 req_id = c4971aa3-2ff0-48b5-913d-27f1b6368af1 response_code = 200 uri = /vpc-routes
34542025-03-25T22:08:21.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34552025-03-25T22:08:21.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33339 req_id = 35f50732-1d64-4357-a787-41a03797ad18 response_code = 204 uri = /eip-gateways
34562025-03-25T22:08:21.299ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34572025-03-25T22:08:21.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39061 req_id = 2efd19f6-0e9e-4570-a1c8-be8a32dd8c2d response_code = 204 uri = /eip-gateways
34582025-03-25T22:08:21.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39061 req_id = 4ef8d200-5d57-4a2f-85ae-e8dbb9b7ee6e response_code = 204 uri = /vpc-routes
34592025-03-25T22:08:21.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64648
34602025-03-25T22:08:21.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64648 req_id = 8481900a-3c84-4e73-a11b-534a2c06a021 response_code = 200 uri = /v2p
34612025-03-25T22:08:21.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33339 req_id = 8e76fd8c-0d0f-449b-88f2-c93650a5f992 response_code = 204 uri = /vpc-routes
34622025-03-25T22:08:21.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61020
34632025-03-25T22:08:21.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61020 req_id = b8940a78-a278-4f35-8b6a-15ace2d04368 response_code = 200 uri = /v2p
34642025-03-25T22:08:21.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43915
34652025-03-25T22:08:21.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43915 req_id = 4b499971-0da3-43f2-8c7e-5290ee8ae548 response_code = 200 uri = /vpc-routes
34662025-03-25T22:08:21.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61256
34672025-03-25T22:08:21.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34682025-03-25T22:08:21.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34692025-03-25T22:08:21.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97256 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61256 req_id = 0199d5ef-dd9a-4dc4-b4eb-b9437eddf168 response_code = 204 uri = /switch-ports
34702025-03-25T22:08:21.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33883
34712025-03-25T22:08:21.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38026
34722025-03-25T22:08:21.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61256 req_id = 09a65184-1abe-4b22-a569-c984bc6e861a response_code = 200 uri = /network-bootstore-config
34732025-03-25T22:08:21.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34742025-03-25T22:08:21.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38026 req_id = b809e0be-6de5-4756-b402-fd14270e13be response_code = 200 uri = /v2p
34752025-03-25T22:08:21.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34762025-03-25T22:08:21.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43915 req_id = 94784370-4db0-4be8-ad98-21336f755610 response_code = 204 uri = /eip-gateways
34772025-03-25T22:08:21.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1031 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43915 req_id = e154c281-8609-4612-b37e-ddaa7343313b response_code = 204 uri = /vpc-routes
34782025-03-25T22:08:21.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34792025-03-25T22:08:21.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33883 req_id = 08848926-8c1b-4559-bafb-8da1a3493389 response_code = 204 uri = /switch-ports
34802025-03-25T22:08:21.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33883 req_id = c24dfdad-61f7-45f3-a172-778cbf7ff522 response_code = 200 uri = /network-bootstore-config
34812025-03-25T22:08:21.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42781
34822025-03-25T22:08:21.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
34832025-03-25T22:08:21.700ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
34842025-03-25T22:08:21.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42781 req_id = 14120a5a-e8da-490b-98a9-0eca97c4698c response_code = 204 uri = /switch-ports
34852025-03-25T22:08:21.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42781 req_id = 7f58955d-d02b-4917-a3ef-3f6afeed1fb4 response_code = 200 uri = /network-bootstore-config
34862025-03-25T22:08:36.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49046
34872025-03-25T22:08:36.003ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49046 req_id = 06a234e5-8019-43f5-b7f0-83d99cc7a905 response_code = 200 uri = /baseboard
34882025-03-25T22:08:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
34892025-03-25T22:08:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
34902025-03-25T22:08:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
34912025-03-25T22:08:36.547ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
34922025-03-25T22:08:43.580ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6061 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 91383fa0-f407-46ca-b924-d212ff769e93 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
34932025-03-25T22:08:51.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33391
34942025-03-25T22:08:51.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33391 req_id = c71a766f-befa-44af-9881-6dbb282bb286 response_code = 200 uri = /vpc-routes
34952025-03-25T22:08:51.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33320
34962025-03-25T22:08:51.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33320 req_id = 17a5b79e-ce3c-4313-bc56-48aca2459f7a response_code = 200 uri = /vpc-routes
34972025-03-25T22:08:51.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
34982025-03-25T22:08:51.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33391 req_id = 5190862c-48aa-4e06-a1cb-b02789527230 response_code = 204 uri = /eip-gateways
34992025-03-25T22:08:51.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33391 req_id = 1ff771be-0b4c-4a6d-aee2-83083d0d54cd response_code = 204 uri = /vpc-routes
35002025-03-25T22:08:51.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35012025-03-25T22:08:51.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33320 req_id = c3a19719-1843-4b8b-858c-7bb37778cb0b response_code = 204 uri = /eip-gateways
35022025-03-25T22:08:51.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33320 req_id = 417d86d5-9734-4927-8ac9-c78d84533aa3 response_code = 204 uri = /vpc-routes
35032025-03-25T22:08:51.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54250
35042025-03-25T22:08:51.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54250 req_id = c3724e5c-aad3-4b6c-91f1-6ca2646e29a6 response_code = 200 uri = /v2p
35052025-03-25T22:08:51.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37799
35062025-03-25T22:08:51.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35072025-03-25T22:08:51.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35082025-03-25T22:08:51.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37799 req_id = 3890afe0-2f2c-4529-81ba-7de2d7a51ded response_code = 204 uri = /switch-ports
35092025-03-25T22:08:51.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55018
35102025-03-25T22:08:51.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51270
35112025-03-25T22:08:51.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63206
35122025-03-25T22:08:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37799 req_id = 11052795-91c9-4ce5-8274-a2110678edb9 response_code = 200 uri = /network-bootstore-config
35132025-03-25T22:08:51.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35142025-03-25T22:08:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51270 req_id = 8e81285c-b369-4a56-9d00-85fde8c2ed2d response_code = 200 uri = /vpc-routes
35152025-03-25T22:08:51.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4019 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55018 req_id = 1f7b2eb5-110f-4341-bf2c-e408fbaa60e3 response_code = 200 uri = /v2p
35162025-03-25T22:08:51.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62446
35172025-03-25T22:08:51.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62446 req_id = 8934f7b4-f31e-4778-8da7-8f8c4c453e38 response_code = 200 uri = /v2p
35182025-03-25T22:08:51.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55712
35192025-03-25T22:08:51.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35202025-03-25T22:08:51.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35212025-03-25T22:08:51.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51270 req_id = 6cfdaabc-8fdf-413d-90cc-2500e008e166 response_code = 204 uri = /eip-gateways
35222025-03-25T22:08:51.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51270 req_id = cffb27dc-0a50-493f-83cd-82ace9fc1808 response_code = 204 uri = /vpc-routes
35232025-03-25T22:08:51.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95002 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63206 req_id = d970590c-fa1f-4cfa-a69b-d47a08989a33 response_code = 204 uri = /switch-ports
35242025-03-25T22:08:51.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35252025-03-25T22:08:51.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63206 req_id = 2fd54a88-3d67-479d-b87d-e65d580c8374 response_code = 200 uri = /network-bootstore-config
35262025-03-25T22:08:51.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35272025-03-25T22:08:51.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55712 req_id = 501b2e15-0579-4f83-ae83-b32d4aa3d10f response_code = 204 uri = /switch-ports
35282025-03-25T22:08:51.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55712 req_id = b2ab56fc-d572-4a17-a049-615446d490b7 response_code = 200 uri = /network-bootstore-config
35292025-03-25T22:09:06.036ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59318
35302025-03-25T22:09:06.036ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59318 req_id = e249d444-5bcb-45e6-a837-8f1556ae2f4d response_code = 200 uri = /baseboard
35312025-03-25T22:09:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6917 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 34cac0e2-9245-493d-b530-e2304f26bbdd response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
35322025-03-25T22:09:21.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60596
35332025-03-25T22:09:21.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60596 req_id = 320435d4-d2b8-4629-8180-f12cd96c1811 response_code = 200 uri = /vpc-routes
35342025-03-25T22:09:21.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35352025-03-25T22:09:21.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60596 req_id = 67055722-c131-4055-9476-11a116b3688a response_code = 204 uri = /eip-gateways
35362025-03-25T22:09:21.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60596 req_id = 3a2b1790-0f31-436e-8ec7-97e8e0a2be20 response_code = 204 uri = /vpc-routes
35372025-03-25T22:09:21.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50063
35382025-03-25T22:09:21.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50063 req_id = a5d2f052-49fc-434f-9465-3edeb2a8c81d response_code = 200 uri = /vpc-routes
35392025-03-25T22:09:21.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35402025-03-25T22:09:21.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50063 req_id = 669f485e-cc73-4aba-ad61-875da2d35073 response_code = 204 uri = /eip-gateways
35412025-03-25T22:09:21.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53213
35422025-03-25T22:09:21.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53213 req_id = 1d0dfadb-bd4a-417d-8e83-36a011753a1a response_code = 200 uri = /v2p
35432025-03-25T22:09:21.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50063 req_id = 20d36a9a-5e2c-4675-9baf-bfbd611e3417 response_code = 204 uri = /vpc-routes
35442025-03-25T22:09:21.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63448
35452025-03-25T22:09:21.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63448 req_id = 3d12106f-1c25-4e3e-95c2-2fd22759e2b5 response_code = 200 uri = /v2p
35462025-03-25T22:09:21.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54578
35472025-03-25T22:09:21.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35482025-03-25T22:09:21.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35492025-03-25T22:09:21.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54578 req_id = 94ed0214-6cdd-4632-bae5-ccd1ab4820dc response_code = 204 uri = /switch-ports
35502025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56494
35512025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48921
35522025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49417
35532025-03-25T22:09:21.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35542025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54578 req_id = 966b4ae7-f67f-41c1-b9fb-e992972c7f1a response_code = 200 uri = /network-bootstore-config
35552025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48921 req_id = 45430f9d-b2e3-43ad-a36c-6f29e20b3c72 response_code = 200 uri = /vpc-routes
35562025-03-25T22:09:21.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49417 req_id = 23e15794-7868-4d54-b701-13985cf9b6c5 response_code = 200 uri = /v2p
35572025-03-25T22:09:21.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35582025-03-25T22:09:21.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35592025-03-25T22:09:21.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48921 req_id = a5b152a1-1edb-4fd6-bb7d-b9e3d3c6594a response_code = 204 uri = /eip-gateways
35602025-03-25T22:09:21.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48921 req_id = 8806eda6-9638-47e0-a07a-013bd8aef2e8 response_code = 204 uri = /vpc-routes
35612025-03-25T22:09:21.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56494 req_id = 01d7257e-2860-4224-a637-bd8e8267aab3 response_code = 204 uri = /switch-ports
35622025-03-25T22:09:21.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56494 req_id = 79aacb4e-7d96-4f64-870a-8bcc3a0d3c8b response_code = 200 uri = /network-bootstore-config
35632025-03-25T22:09:21.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41955
35642025-03-25T22:09:21.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35652025-03-25T22:09:21.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35662025-03-25T22:09:21.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41955 req_id = 0fb78ead-ffc0-4bda-8181-67407078849c response_code = 204 uri = /switch-ports
35672025-03-25T22:09:21.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41955 req_id = cc0ad52f-8351-455a-8c8c-ce7b629904bb response_code = 200 uri = /network-bootstore-config
35682025-03-25T22:09:32.985ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
35692025-03-25T22:09:36.068ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64724
35702025-03-25T22:09:36.068ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64724 req_id = ddee0562-5e39-44a9-9ed3-306ba79cd397 response_code = 200 uri = /baseboard
35712025-03-25T22:09:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
35722025-03-25T22:09:36.538ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
35732025-03-25T22:09:36.540ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
35742025-03-25T22:09:36.540ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
35752025-03-25T22:09:43.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6280 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = b8441a23-4a80-471f-beac-c07cc202dc8d response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
35762025-03-25T22:09:51.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49736
35772025-03-25T22:09:51.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49736 req_id = 44ef233d-9c0b-44ea-b3ab-ac233714376b response_code = 200 uri = /vpc-routes
35782025-03-25T22:09:51.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35792025-03-25T22:09:51.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49736 req_id = aac19f64-e860-4e1f-a797-819b576009b3 response_code = 204 uri = /eip-gateways
35802025-03-25T22:09:51.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38873
35812025-03-25T22:09:51.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38873 req_id = b0c4460c-a9ba-4098-b4a1-c15918ddd39b response_code = 200 uri = /v2p
35822025-03-25T22:09:51.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49736 req_id = 9bce3da7-c812-4ed2-a2ef-4919d6b211e6 response_code = 204 uri = /vpc-routes
35832025-03-25T22:09:51.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63652
35842025-03-25T22:09:51.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63652 req_id = dc6fa8c6-d33e-452e-a895-c34a31042aa3 response_code = 200 uri = /vpc-routes
35852025-03-25T22:09:51.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48560
35862025-03-25T22:09:51.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35872025-03-25T22:09:51.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
35882025-03-25T22:09:51.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48560 req_id = 9f69ef83-1151-479a-a2fc-18ceaef65d5e response_code = 204 uri = /switch-ports
35892025-03-25T22:09:51.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50237
35902025-03-25T22:09:51.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42233
35912025-03-25T22:09:51.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64046
35922025-03-25T22:09:51.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
35932025-03-25T22:09:51.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63652 req_id = bee19406-2b6f-4d29-986e-47ea96f22db8 response_code = 204 uri = /eip-gateways
35942025-03-25T22:09:51.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48560 req_id = 9e91f385-0022-4133-8c3c-7d85bc4d38eb response_code = 200 uri = /network-bootstore-config
35952025-03-25T22:09:51.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50237 req_id = 30efdeb4-a9f6-43f5-8aa8-1ac248bc2183 response_code = 200 uri = /vpc-routes
35962025-03-25T22:09:51.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64046 req_id = 5ec76479-43bd-4e12-be35-9f95e138327f response_code = 200 uri = /v2p
35972025-03-25T22:09:51.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
35982025-03-25T22:09:51.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63652 req_id = 13991ac1-2f9c-4ac5-9c56-d9fdf2588829 response_code = 204 uri = /vpc-routes
35992025-03-25T22:09:51.316ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36002025-03-25T22:09:51.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
36012025-03-25T22:09:51.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50237 req_id = 42d8cc9e-4127-4e9f-992a-dff1c3ea936c response_code = 204 uri = /eip-gateways
36022025-03-25T22:09:51.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50237 req_id = 211bb464-b6ab-4ad5-8f1f-d676905f4b29 response_code = 204 uri = /vpc-routes
36032025-03-25T22:09:51.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47522
36042025-03-25T22:09:51.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42233 req_id = c0cfea23-0d32-41bc-89d2-9e7d1d08529c response_code = 204 uri = /switch-ports
36052025-03-25T22:09:51.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47522 req_id = e798d54d-7f2c-4fff-b803-3e1a1c8d7870 response_code = 200 uri = /v2p
36062025-03-25T22:09:51.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42233 req_id = c21f66f1-1c09-4f15-b46b-2b516b63886a response_code = 200 uri = /network-bootstore-config
36072025-03-25T22:09:51.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33504
36082025-03-25T22:09:51.438ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36092025-03-25T22:09:51.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36102025-03-25T22:09:51.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33504 req_id = 0107b138-9531-484a-82e2-d75833f2e497 response_code = 204 uri = /switch-ports
36112025-03-25T22:09:51.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33504 req_id = 8ecbe257-8c3f-4ee3-ba43-a99c7ed12d26 response_code = 200 uri = /network-bootstore-config
36122025-03-25T22:10:06.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37773
36132025-03-25T22:10:06.100ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37773 req_id = 82b4e915-bbfb-4233-8d6a-3bebf84a6c7d response_code = 200 uri = /baseboard
36142025-03-25T22:10:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6981 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 38849a4b-bf75-47c7-aa3b-890632903dc9 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
36152025-03-25T22:10:21.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57154
36162025-03-25T22:10:21.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57154 req_id = 9e08b315-95f2-4c2f-ac90-45c993edf48e response_code = 200 uri = /vpc-routes
36172025-03-25T22:10:21.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36692
36182025-03-25T22:10:21.240ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36192025-03-25T22:10:21.240ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36202025-03-25T22:10:21.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36692 req_id = 600ce9a0-321a-4ee3-953e-1e56bc4ee3a1 response_code = 204 uri = /artifacts-config
36212025-03-25T22:10:21.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36222025-03-25T22:10:21.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36692 req_id = f3103f90-ac9a-43cb-af96-5413d7b992a9 response_code = 200 uri = /artifacts
36232025-03-25T22:10:21.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
36242025-03-25T22:10:21.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57154 req_id = e69c535e-3152-49de-8c19-1ff717f3e741 response_code = 204 uri = /eip-gateways
36252025-03-25T22:10:21.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57154 req_id = 1de220ef-e465-4a20-9c71-64dd33e15913 response_code = 204 uri = /vpc-routes
36262025-03-25T22:10:21.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59557
36272025-03-25T22:10:21.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59557 req_id = 0d986a49-150c-4ba7-a0a7-bc1466412b42 response_code = 200 uri = /vpc-routes
36282025-03-25T22:10:21.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54598
36292025-03-25T22:10:21.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54598 req_id = ca71cd56-d23a-40a9-885f-d8106661a36c response_code = 200 uri = /vpc-routes
36302025-03-25T22:10:21.415ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
36312025-03-25T22:10:21.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54598 req_id = 531003b5-93ba-4b6e-a68c-4c42b762f327 response_code = 204 uri = /eip-gateways
36322025-03-25T22:10:21.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54598 req_id = 46001176-9c10-458a-9371-45757e0d2f6b response_code = 204 uri = /vpc-routes
36332025-03-25T22:10:21.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32861
36342025-03-25T22:10:21.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36352025-03-25T22:10:21.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36362025-03-25T22:10:21.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32861 req_id = 7104efae-ed52-44c7-9097-b4b4361b9a00 response_code = 204 uri = /switch-ports
36372025-03-25T22:10:21.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61110
36382025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37070
36392025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39549
36402025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55537
36412025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32861 req_id = 11849bce-b4d4-4eb2-914e-001e7e97900f response_code = 200 uri = /network-bootstore-config
36422025-03-25T22:10:21.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36432025-03-25T22:10:21.600ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36442025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55537 req_id = 9c0fc938-6b01-4380-b493-18c449dce672 response_code = 200 uri = /v2p
36452025-03-25T22:10:21.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39549 req_id = c01f00e7-2f44-44dd-a66a-ef4028454c92 response_code = 200 uri = /v2p
36462025-03-25T22:10:21.600ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36472025-03-25T22:10:21.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61110 req_id = e149d5f9-6873-4c44-a41d-1ec3fec7acdc response_code = 204 uri = /artifacts-config
36482025-03-25T22:10:21.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36492025-03-25T22:10:21.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61110 req_id = 9027a268-0678-4a44-af62-54cee3a998f3 response_code = 200 uri = /artifacts
36502025-03-25T22:10:21.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38271
36512025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
36522025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36532025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36542025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
36552025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
36562025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
36572025-03-25T22:10:21.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
36582025-03-25T22:10:21.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38271 req_id = bda8489a-6edf-4c30-93ee-1cd0f0e8062c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
36592025-03-25T22:10:21.649ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36602025-03-25T22:10:21.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61264
36612025-03-25T22:10:21.712ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36622025-03-25T22:10:21.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62777
36632025-03-25T22:10:21.712ZINFOSledAgent (ArtifactStore): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/update/artifact-config.json file = common/src/ledger.rs:175 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
36642025-03-25T22:10:21.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61264 req_id = edcae529-ae06-42d6-a485-5f2c30d3f0e4 response_code = 204 uri = /artifacts-config
36652025-03-25T22:10:21.712ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36662025-03-25T22:10:21.712ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36672025-03-25T22:10:21.712ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
36682025-03-25T22:10:21.712ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36692025-03-25T22:10:21.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61264 req_id = 1b90b292-fa45-4428-8373-b08109c2625c response_code = 200 uri = /artifacts
36702025-03-25T22:10:21.713ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
36712025-03-25T22:10:21.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
36722025-03-25T22:10:21.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59557 req_id = 86a7d32c-52ea-4b9a-9681-ab2db52bde3f response_code = 204 uri = /eip-gateways
36732025-03-25T22:10:21.731ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36742025-03-25T22:10:21.731ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
36752025-03-25T22:10:21.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140596 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37070 req_id = 87032ad3-ff43-40fb-8faf-b266e6f0a9e1 response_code = 204 uri = /switch-ports
36762025-03-25T22:10:21.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1079 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59557 req_id = d59dde1e-e7ad-47fa-8b23-9dd549eb882f response_code = 204 uri = /vpc-routes
36772025-03-25T22:10:21.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37070 req_id = 8b48ccd1-0f7d-416a-9413-b0e23a2dde33 response_code = 200 uri = /network-bootstore-config
36782025-03-25T22:10:21.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64621
36792025-03-25T22:10:21.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
36802025-03-25T22:10:21.767ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36812025-03-25T22:10:21.768ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
36822025-03-25T22:10:21.800ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36832025-03-25T22:10:21.800ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
36842025-03-25T22:10:21.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
36852025-03-25T22:10:21.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36862025-03-25T22:10:21.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
36872025-03-25T22:10:21.862ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36882025-03-25T22:10:21.862ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
36892025-03-25T22:10:21.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40524
36902025-03-25T22:10:21.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36912025-03-25T22:10:21.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
36922025-03-25T22:10:21.877ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
36932025-03-25T22:10:21.882ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
36942025-03-25T22:10:21.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64621 req_id = 27d899ef-18f8-4e1c-b59a-676e9550a148 response_code = 204 uri = /switch-ports
36952025-03-25T22:10:21.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64621 req_id = 122988fa-c05b-4656-9822-05d0e4c65171 response_code = 200 uri = /network-bootstore-config
36962025-03-25T22:10:21.891ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36972025-03-25T22:10:21.891ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
36982025-03-25T22:10:21.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
36992025-03-25T22:10:21.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
37002025-03-25T22:10:21.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63119
37012025-03-25T22:10:21.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63119 req_id = d704e6d0-5d7c-451e-8b44-e905cf2e7996 response_code = 200 uri = /v2p
37022025-03-25T22:10:21.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37032025-03-25T22:10:21.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
37042025-03-25T22:10:21.944ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37052025-03-25T22:10:21.944ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
37062025-03-25T22:10:21.960ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37072025-03-25T22:10:21.960ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
37082025-03-25T22:10:21.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54471
37092025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
37102025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37112025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37122025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37132025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37142025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
37152025-03-25T22:10:21.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37162025-03-25T22:10:21.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 638 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54471 req_id = 1995f474-99e4-4967-87a9-b70266061aa9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37172025-03-25T22:10:21.975ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37182025-03-25T22:10:21.975ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
37192025-03-25T22:10:22.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37202025-03-25T22:10:22.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
37212025-03-25T22:10:22.017ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37222025-03-25T22:10:22.017ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
37232025-03-25T22:10:22.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62777 req_id = 91aa5d79-d2e7-4189-aa37-f99d1c00c5a3 response_code = 200 uri = /inventory
37242025-03-25T22:10:22.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37252025-03-25T22:10:22.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
37262025-03-25T22:10:22.063ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37272025-03-25T22:10:22.063ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
37282025-03-25T22:10:22.084ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37292025-03-25T22:10:22.084ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
37302025-03-25T22:10:22.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37312025-03-25T22:10:22.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
37322025-03-25T22:10:22.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37332025-03-25T22:10:22.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
37342025-03-25T22:10:22.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40524 req_id = d1c08bb8-abb3-47a8-9100-f8cec964e5f2 response_code = 200 uri = /inventory
37352025-03-25T22:10:22.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46538
37362025-03-25T22:10:22.197ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29ce53a2-9f51-4baa-936c-a430afb38f28, kind: Service { id: d42076c6-06fe-4102-a978-c7d0a8dffb98 }, name: Name("external-dns-d42076c6-06fe-4102-a978-c7d0a8dffb98"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 55e2e815-bc90-43ee-bb61-e37b76792d5f, kind: Service { id: 58d382a7-99da-40a7-bc9f-2da7e9b156c1 }, name: Name("external-dns-58d382a7-99da-40a7-bc9f-2da7e9b156c1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 30])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12a41e9e-9631-4d38-b839-8dd2f1307510, kind: Service { id: f578ebd7-76c9-43f2-8d8c-99a164224c1c }, name: Name("nexus-f578ebd7-76c9-43f2-8d8c-99a164224c1c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 27c97441-bb9e-4408-b832-44b304dbd319, kind: Service { id: dc04dd71-e9ce-4d94-8637-d87f47eb7409 }, name: Name("nexus-dc04dd71-e9ce-4d94-8637-d87f47eb7409"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de8b1653-42da-41b0-b524-fe87fd1390a1, kind: Service { id: 76a4636e-6952-47a1-8a71-cd6816e00858 }, name: Name("nexus-76a4636e-6952-47a1-8a71-cd6816e00858"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
37372025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37382025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37392025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37402025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
37412025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
37422025-03-25T22:10:22.198ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
37432025-03-25T22:10:22.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46538 req_id = d9c226c2-c560-4da1-8f96-16ccb3915bc7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37442025-03-25T22:10:23.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60567
37452025-03-25T22:10:23.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37462025-03-25T22:10:23.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37472025-03-25T22:10:23.643ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/config/omicron-zones.json file = common/src/ledger.rs:175
37482025-03-25T22:10:23.644ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/config/omicron-zones.json file = common/src/ledger.rs:175
37492025-03-25T22:10:23.657ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71268b50-af17-4f9b-9d99-5d6dcff2817c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37502025-03-25T22:10:23.657ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_71268b50-af17-4f9b-9d99-5d6dcff2817c
37512025-03-25T22:10:23.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 783a51a0-e2a9-496d-ad97-3f74cd91e25d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37522025-03-25T22:10:23.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_783a51a0-e2a9-496d-ad97-3f74cd91e25d
37532025-03-25T22:10:23.705ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f92ee940-58a4-42f3-8249-a9824705ae7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37542025-03-25T22:10:23.705ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_f92ee940-58a4-42f3-8249-a9824705ae7b
37552025-03-25T22:10:23.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d5f61f1-c929-46ea-9069-0d1ef51c2f6c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37562025-03-25T22:10:23.725ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_2d5f61f1-c929-46ea-9069-0d1ef51c2f6c
37572025-03-25T22:10:23.747ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 658c7410-c0e1-4aa5-b43c-c3aedc82ed01 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37582025-03-25T22:10:23.747ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_658c7410-c0e1-4aa5-b43c-c3aedc82ed01
37592025-03-25T22:10:23.766ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11b7ad91-239c-41f7-9af3-7be28c8d1c71 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37602025-03-25T22:10:23.766ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_11b7ad91-239c-41f7-9af3-7be28c8d1c71
37612025-03-25T22:10:23.783ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c7612302-467a-4fb4-95ed-2f8bcbf04aa8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37622025-03-25T22:10:23.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_c7612302-467a-4fb4-95ed-2f8bcbf04aa8
37632025-03-25T22:10:23.804ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cb403e6-797e-4379-973b-713f596fb1b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37642025-03-25T22:10:23.804ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_9cb403e6-797e-4379-973b-713f596fb1b1
37652025-03-25T22:10:23.825ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6eb6c9ab-db85-415d-bc3e-5f3c13034126 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
37662025-03-25T22:10:23.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1122 request = datasets_list zpool = oxp_6eb6c9ab-db85-415d-bc3e-5f3c13034126
37672025-03-25T22:10:23.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60567 req_id = 249117c0-6342-480f-b3a1-35d25baded10 response_code = 200 uri = /inventory
37682025-03-25T22:10:36.134ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57211
37692025-03-25T22:10:36.134ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57211 req_id = be80b68d-4699-4e61-a310-d1e6afa348da response_code = 200 uri = /baseboard
37702025-03-25T22:10:36.537ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:204
37712025-03-25T22:10:36.537ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:212
37722025-03-25T22:10:36.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:222
37732025-03-25T22:10:36.540ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:237
37742025-03-25T22:10:43.583ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7776 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = 74d2493a-b1a8-4ddf-82f7-8ff8875cd049 response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28
37752025-03-25T22:10:47.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36847
37762025-03-25T22:10:47.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36847 req_id = d46eaf6f-f094-4c0a-b237-68b4ddcecaa8 response_code = 200 uri = /v2p
37772025-03-25T22:10:47.887ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4754106) }
37782025-03-25T22:10:47.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 945 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36847 req_id = 7dffa0b1-526e-48bc-9324-c38d2f1df133 response_code = 204 uri = /v2p
37792025-03-25T22:10:48.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36926
37802025-03-25T22:10:48.053ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4754106))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ce37f8db-095f-4337-b4c6-26454e26f5b1, slot: 0, read_only: false, vcr_json: .., name: "disk-ad54a00f824" }], boot_settings: Some(InstanceBootSettings { order: [ce37f8db-095f-4337-b4c6-26454e26f5b1] }), cloud_init_bytes: Some(..) } instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d metadata = InstanceMetadata { silo_id: 5c35ff8c-21dd-48b9-9751-76bfa681bc38, project_id: 8d0ea42b-d77d-424d-a7af-1db382bd9f03 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-25T22:10:48.035923597Z }
37812025-03-25T22:10:48.053ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d migration_id = None propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
37822025-03-25T22:10:48.053ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1717 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d migration_id = None propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4754106))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51c96537-3876-409e-8967-6e6cd1c05921, kind: Instance { id: a41f22f9-aa36-48e8-a4b9-411391eb187d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4754106), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ce37f8db-095f-4337-b4c6-26454e26f5b1, slot: 0, read_only: false, vcr_json: .., name: "disk-ad54a00f824" }], boot_settings: Some(InstanceBootSettings { order: [ce37f8db-095f-4337-b4c6-26454e26f5b1] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-25T22:10:48.035923597Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
37832025-03-25T22:10:48.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36926 req_id = 0ad27817-8c5d-460c-9b3a-bdc4f28e86d4 response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554
37842025-03-25T22:10:48.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63718
37852025-03-25T22:10:48.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1613 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63718 req_id = 4dc52683-2208-4806-963c-5e1ef8c13950 response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
37862025-03-25T22:10:48.166ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4754106 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
37872025-03-25T22:10:48.166ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
37882025-03-25T22:10:48.209ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554 file = illumos-utils/src/zone.rs:356 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
37892025-03-25T22:10:48.235ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554 file = illumos-utils/src/zone.rs:394 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
37902025-03-25T22:10:48.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57314
37912025-03-25T22:10:48.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57314 req_id = f79669de-5981-403b-a3a5-7a74796aa4b6 response_code = 200 uri = /vpc-routes
37922025-03-25T22:10:48.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}}} }
37932025-03-25T22:10:49.994ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
37942025-03-25T22:10:49.994ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554 zone file = illumos-utils/src/running_zone.rs:491 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
37952025-03-25T22:10:50.181ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 33.051569ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
37962025-03-25T22:10:50.224ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 55.147742ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
37972025-03-25T22:10:50.299ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 222.304904ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
37982025-03-25T22:10:50.538ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 356.715544ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
37992025-03-25T22:10:50.911ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 828.885127ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
38002025-03-25T22:10:51.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63916
38012025-03-25T22:10:51.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63916 req_id = cf32237f-5e84-40b6-815b-79e32b4259e6 response_code = 200 uri = /vpc-routes
38022025-03-25T22:10:51.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46331
38032025-03-25T22:10:51.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46171
38042025-03-25T22:10:51.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46171 req_id = a0365805-b774-4b5c-83f2-ae459aa65544 response_code = 200 uri = /vpc-routes
38052025-03-25T22:10:51.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33976
38062025-03-25T22:10:51.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}}} }
38072025-03-25T22:10:51.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46171 req_id = bbfdccdf-f618-4522-85ed-86a148def600 response_code = 204 uri = /eip-gateways
38082025-03-25T22:10:51.219ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}}} }
38092025-03-25T22:10:51.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63916 req_id = fccc89b2-464f-45c5-9beb-4944b61eb86f response_code = 204 uri = /eip-gateways
38102025-03-25T22:10:51.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44690
38112025-03-25T22:10:51.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38122025-03-25T22:10:51.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38132025-03-25T22:10:51.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44690 req_id = 438d9bd1-ae3e-464f-9163-950a9de8ab9c response_code = 204 uri = /switch-ports
38142025-03-25T22:10:51.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63925
38152025-03-25T22:10:51.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46255
38162025-03-25T22:10:51.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44690 req_id = 65946f94-57c2-4140-b32c-5e4b8b402c73 response_code = 200 uri = /network-bootstore-config
38172025-03-25T22:10:51.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38182025-03-25T22:10:51.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63916 req_id = b61a05dd-5047-4e5f-88b9-dd9b5bcb1554 response_code = 204 uri = /vpc-routes
38192025-03-25T22:10:51.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52203
38202025-03-25T22:10:51.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52203 req_id = e0749b22-c419-407b-8586-9d4d3f257b87 response_code = 200 uri = /v2p
38212025-03-25T22:10:51.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38222025-03-25T22:10:51.454ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, version: 3 } old_vers = RouterVersion { router_id: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, version: 3 } subnet = RouterId { vni: Vni(4754106), kind: System }
38232025-03-25T22:10:51.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46171 req_id = bc93079f-1007-4996-8136-3ded16970d6d response_code = 204 uri = /vpc-routes
38242025-03-25T22:10:51.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56568
38252025-03-25T22:10:51.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35388
38262025-03-25T22:10:51.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35388 req_id = 88b4bdb7-2f77-4a18-92c1-cdee7c402a99 response_code = 200 uri = /v2p
38272025-03-25T22:10:51.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39753
38282025-03-25T22:10:51.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39753 req_id = fca15ecd-3e8e-460e-b49d-e457d673ad7c response_code = 200 uri = /v2p
38292025-03-25T22:10:51.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46255 req_id = d50b67a3-1fff-480f-a587-903a08bda4c7 response_code = 204 uri = /switch-ports
38302025-03-25T22:10:51.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4253
38312025-03-25T22:10:51.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 833 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46255 req_id = bac027bc-1b07-4ca6-81ea-a3bf02c0fae0 response_code = 200 uri = /network-bootstore-config
38322025-03-25T22:10:51.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4277
38332025-03-25T22:10:51.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159114 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56568 req_id = 526df136-6aa3-489b-b617-4e1631e62cea response_code = 204 uri = /switch-ports
38342025-03-25T22:10:51.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56568 req_id = ecbe6c42-c888-4b7d-a816-105276dcb54f response_code = 200 uri = /network-bootstore-config
38352025-03-25T22:10:51.756ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 880.415641ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
38362025-03-25T22:10:52.648ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 1.180273611s file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
38372025-03-25T22:10:53.840ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 1.419324375s file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 zone = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
38382025-03-25T22:10:55.289ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554 file = sled-agent/src/instance.rs:2225 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38392025-03-25T22:10:55.300ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 26.317348ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38402025-03-25T22:10:55.337ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 89.950751ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38412025-03-25T22:10:55.438ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 167.420301ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38422025-03-25T22:10:55.618ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554") failed: Property not found. retry in 565.945691ms file = illumos-utils/src/svc.rs:42 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38432025-03-25T22:10:56.196ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2234 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38442025-03-25T22:10:56.233ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2258 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38452025-03-25T22:10:56.317ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1343 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38462025-03-25T22:10:56.318ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1277 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
38472025-03-25T22:10:56.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5193697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46331 req_id = 0c628da2-19b4-4a99-81df-2cc72057bb61 response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
38482025-03-25T22:10:56.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4954642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63925 req_id = ee832d7d-eb49-477c-8833-0bf4c7308391 response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
38492025-03-25T22:10:56.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8009923 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57314 req_id = 2408d37c-f873-4196-8b86-5be181fdc281 response_code = 204 uri = /eip-gateways
38502025-03-25T22:10:56.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5165907 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33976 req_id = c35921d3-2648-4400-af51-b2e76b2c43ea response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
38512025-03-25T22:10:56.319ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-25T22:10:56.319401933Z } file = sled-agent/src/instance.rs:904 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38522025-03-25T22:10:56.319ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-25T22:10:56.319401933Z } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38532025-03-25T22:10:56.319ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-25T22:10:56.319401933Z }, migration_in: None, migration_out: None }
38542025-03-25T22:10:56.392ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-25T22:10:56.392205925Z } file = sled-agent/src/instance.rs:904 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38552025-03-25T22:10:56.392ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-25T22:10:56.392205925Z } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38562025-03-25T22:10:56.392ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-25T22:10:56.392205925Z }, migration_in: None, migration_out: None }
38572025-03-25T22:10:56.479ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, version: 3 } old_vers = RouterVersion { router_id: a9b52b9b-3b57-4a0e-8758-03d08c794bfa, version: 3 } subnet = RouterId { vni: Vni(4754106), kind: System }
38582025-03-25T22:10:56.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57314 req_id = 67b17700-b1bd-4011-b972-ad2ec4ecccd6 response_code = 204 uri = /vpc-routes
38592025-03-25T22:10:56.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63212
38602025-03-25T22:10:56.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63212 req_id = ac659f1a-af61-41d6-99dc-f7e980bbd994 response_code = 200 uri = /vpc-routes
38612025-03-25T22:10:56.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}}} }
38622025-03-25T22:10:56.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63212 req_id = 6a114c3f-e381-423a-bafa-c9f1589701db response_code = 204 uri = /eip-gateways
38632025-03-25T22:10:56.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63212 req_id = 5e579702-e518-4097-a100-7b78acf30f09 response_code = 204 uri = /vpc-routes
38642025-03-25T22:11:05.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62706
38652025-03-25T22:11:05.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 509 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62706 req_id = f333b8d7-b2e5-4a47-8aaa-a62d41969139 response_code = 200 uri = /vmms/bf47b3f0-835f-454a-8f60-83602eb93554/state
38662025-03-25T22:11:05.720ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-25T22:11:05.720904188Z } file = sled-agent/src/instance.rs:904 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38672025-03-25T22:11:05.720ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-25T22:11:05.720904188Z } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38682025-03-25T22:11:05.720ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-25T22:11:05.720904188Z }, migration_in: None, migration_out: None }
38692025-03-25T22:11:05.743ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-25T22:11:05.743423491Z } file = sled-agent/src/instance.rs:904 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38702025-03-25T22:11:05.743ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:926 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-25T22:11:05.743423491Z } propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38712025-03-25T22:11:05.743ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:940 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38722025-03-25T22:11:05.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
38732025-03-25T22:11:05.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
38742025-03-25T22:11:05.743ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/7067d582-a933-4db2-a989-84ac7b8cd012/debug/bundle/zone", "/pool/int/f80f2cdc-0e38-40dd-8afe-efcd7214bccc/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/71268b50-af17-4f9b-9d99-5d6dcff2817c/crypt/debug", "/pool/ext/783a51a0-e2a9-496d-ad97-3f74cd91e25d/crypt/debug", "/pool/ext/f92ee940-58a4-42f3-8249-a9824705ae7b/crypt/debug", "/pool/ext/2d5f61f1-c929-46ea-9069-0d1ef51c2f6c/crypt/debug", "/pool/ext/658c7410-c0e1-4aa5-b43c-c3aedc82ed01/crypt/debug", "/pool/ext/11b7ad91-239c-41f7-9af3-7be28c8d1c71/crypt/debug", "/pool/ext/c7612302-467a-4fb4-95ed-2f8bcbf04aa8/crypt/debug", "/pool/ext/9cb403e6-797e-4379-973b-713f596fb1b1/crypt/debug", "/pool/ext/6eb6c9ab-db85-415d-bc3e-5f3c13034126/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:354 zone_name = oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554
38752025-03-25T22:11:06.170ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43475
38762025-03-25T22:11:06.170ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43475 req_id = bc7af702-41af-418d-9b16-66575293be05 response_code = 200 uri = /baseboard
38772025-03-25T22:11:06.405ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1159 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554", bundle_id: 38b59643-887a-4cc2-8a8a-c9b8a9daa55e }, time_created: 2025-03-25T22:11:05.744539021Z, version: 0, cause: TerminatedInstance }
38782025-03-25T22:11:06.406ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_bf47b3f0-835f-454a-8f60-83602eb93554 file = sled-agent/src/instance.rs:1444 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38792025-03-25T22:11:08.140ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:310 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38802025-03-25T22:11:08.159ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(4754106), kind: System }
38812025-03-25T22:11:08.159ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(4754106), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
38822025-03-25T22:11:08.159ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-25T22:11:08.159385993Z }, migration_in: None, migration_out: None }
38832025-03-25T22:11:08.238ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:823 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-25T22:11:08.159385993Z }, migration_in: None, migration_out: None }
38842025-03-25T22:11:08.243ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1381 instance_id = a41f22f9-aa36-48e8-a4b9-411391eb187d propolis_id = bf47b3f0-835f-454a-8f60-83602eb93554
38852025-03-25T22:11:08.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39362
38862025-03-25T22:11:08.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39362 req_id = 5697d2c7-89ad-4433-9b3d-b0427802d8e5 response_code = 200 uri = /vpc-routes
38872025-03-25T22:11:08.877ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {51c96537-3876-409e-8967-6e6cd1c05921: {10.151.2.175: {7797b4f0-9b76-4135-b55c-23637b7be801}, 10.151.2.176: {7797b4f0-9b76-4135-b55c-23637b7be801}}} }
38882025-03-25T22:11:08.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39362 req_id = 0c395db6-6aee-459c-9fe8-7f263adf6a50 response_code = 204 uri = /eip-gateways
38892025-03-25T22:11:08.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39362 req_id = 091fe599-36a6-4fa4-aa8e-bc526263fc86 response_code = 204 uri = /vpc-routes
38902025-03-25T22:11:09.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41930
38912025-03-25T22:11:09.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41930 req_id = 5def7f19-c172-456f-a78c-721e36b7c97f response_code = 200 uri = /v2p
38922025-03-25T22:11:10.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64512
38932025-03-25T22:11:10.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64512 req_id = a4cf0d6f-c4c0-4530-8caa-bdffb3fa1ef5 response_code = 200 uri = /v2p
38942025-03-25T22:11:10.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39561
38952025-03-25T22:11:10.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39561 req_id = 49521edd-4981-462d-9962-b5348d261493 response_code = 200 uri = /vpc-routes
38962025-03-25T22:11:10.405ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
38972025-03-25T22:11:10.405ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1277 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28
38982025-03-25T22:11:10.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39561 req_id = 64f96b7b-eff8-446d-beb1-09cbb00c5615 response_code = 204 uri = /eip-gateways
38992025-03-25T22:11:10.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39561 req_id = a96b470b-631b-4f74-ab2b-7462eb948140 response_code = 204 uri = /vpc-routes
39002025-03-25T22:11:11.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55092
39012025-03-25T22:11:11.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55092 req_id = 01069486-d24e-4b08-a725-5f7be11738a1 response_code = 200 uri = /vpc-routes
39022025-03-25T22:11:11.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1251 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 values = ExternalIpGatewayMap { mappings: {} }
39032025-03-25T22:11:11.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55092 req_id = 643d1e0a-8d6a-419c-bcf6-083f3e5fa465 response_code = 204 uri = /eip-gateways
39042025-03-25T22:11:11.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55092 req_id = a48d73cb-1e1f-4537-ad72-b08bc5bc1ca2 response_code = 204 uri = /vpc-routes
39052025-03-25T22:11:13.581ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6439 local_addr = [fd00:1122:3344:101::1]:56707 method = GET remote_addr = [fd00:1122:3344:101::d]:55665 req_id = d69d888b-c154-48f4-a04c-987dff6b1e5e response_code = 200 sled_id = f034aaf6-2037-4cb4-8409-3ab31c15cc28 uri = /f034aaf6-2037-4cb4-8409-3ab31c15cc28