Max level shown:
1 [ Mar 21 18:38:20 Enabled. ]
2 [ Mar 21 18:38:20 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 21 18:38:20 Method "start" exited with status 0. ]
4 [ Mar 21 18:38:20 Rereading configuration. ]
5 [ Mar 21 18:38:20 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-21T18:38:20.422ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-21T18:38:20.422ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-21T18:38:20.476ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-21T18:38:20.476ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-21T18:38:20.592ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-21T18:38:20.601ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-21T18:38:20.609ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-21T18:38:21.221ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
152025-03-21T18:38:21.223ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }]
162025-03-21T18:38:21.223ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
172025-03-21T18:38:21.352ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-21T18:38:21.352ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-21T18:38:21.352ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-21T18:38:21.353ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
212025-03-21T18:38:21.353ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
222025-03-21T18:38:21.353ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
232025-03-21T18:38:21.356ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-21T18:38:21.356ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-21T18:38:21.356ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-21T18:38:21.356ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-21T18:38:21.356ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-21T18:38:21.356ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-21T18:38:21.356ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-21T18:38:21.356ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-21T18:38:21.356ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-21T18:38:21.368ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-21T18:38:21.368ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool)
342025-03-21T18:38:21.496ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal }
352025-03-21T18:38:21.939ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-21T18:38:21.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-21T18:38:21.939ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-21T18:38:21.939ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-21T18:38:21.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-21T18:38:21.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-21T18:38:21.939ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-21T18:38:21.947ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-21T18:38:21.947ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = eabe7796-89f9-4e63-b1df-63201e46213d (zpool)
442025-03-21T18:38:22.062ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal }
452025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
492025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
502025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
542025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
552025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
562025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
582025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
612025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
622025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
782025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
792025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
802025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
812025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
842025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
852025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
862025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
872025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
882025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
902025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
912025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
922025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
932025-03-21T18:38:22.545ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
942025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
962025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
972025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
982025-03-21T18:38:22.545ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
992025-03-21T18:38:22.545ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-21T18:38:22.545ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1022025-03-21T18:38:22.545ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1032025-03-21T18:38:22.545ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1042025-03-21T18:38:22.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1052025-03-21T18:38:22.545ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-21T18:38:22.545ZINFOSledAgent (bootstore): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1072025-03-21T18:38:22.545ZINFOSledAgent (bootstore): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1082025-03-21T18:38:22.545ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1092025-03-21T18:38:22.545ZINFOSledAgent (bootstore): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1102025-03-21T18:38:22.546ZINFOSledAgent (bootstore): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1112025-03-21T18:38:22.546ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1122025-03-21T18:38:22.546ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-21T18:38:22.546ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-21T18:38:22.557ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:794
1152025-03-21T18:38:22.557ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1367, tv_nsec: 482278416 } time_to_next_cleanup = 599.999942519s
1162025-03-21T18:38:22.557ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
1172025-03-21T18:38:22.557ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-21T18:38:22.559ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-21T18:38:22.559ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-21T18:38:22.560ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1212025-03-21T18:38:22.562ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1222025-03-21T18:38:22.562ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1257
1232025-03-21T18:38:22.562ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-21T18:38:22.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-21T18:38:22.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-21T18:38:22.562ZINFOSledAgent (RSS): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-21T18:38:22.562ZINFOSledAgent (RSS): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-21T18:38:22.562ZINFOSledAgent (RSS): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-21T18:38:22.562ZINFOSledAgent (RSS): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-21T18:38:22.562ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1306
1312025-03-21T18:38:22.562ZINFOSledAgent (RSS): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-21T18:38:22.562ZINFOSledAgent (RSS): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-21T18:38:22.563ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1338
1342025-03-21T18:38:22.563ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-21T18:38:22.563ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-21T18:38:22.563ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1369
1372025-03-21T18:38:22.563ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382025-03-21T18:38:22.563ZINFOSledAgent (bootstore): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1392025-03-21T18:38:22.563ZINFOSledAgent (bootstore): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1402025-03-21T18:38:22.563ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412025-03-21T18:38:22.564ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 84074e7c-1a32-4c31-a122-c0b819b9b406 (sled), rack_id: 824266aa-507b-4201-8ccd-ac7c6cbafcf0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422025-03-21T18:38:22.564ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4319
1432025-03-21T18:38:22.564ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4740
1442025-03-21T18:38:22.568ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-21T18:38:22.573ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-21T18:38:22.574ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-21T18:38:22.578ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-21T18:38:22.578ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-21T18:38:22.579ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:55475
1502025-03-21T18:38:22.579ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 84074e7c-1a32-4c31-a122-c0b819b9b406 (sled), rack_id: 824266aa-507b-4201-8ccd-ac7c6cbafcf0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:358
1512025-03-21T18:38:22.579ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:373
1522025-03-21T18:38:22.579ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-21T18:38:22.579ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1552025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-21T18:38:22.579ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1622025-03-21T18:38:22.579ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-21T18:38:22.595ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-21T18:38:22.616ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:327
1652025-03-21T18:38:22.633ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:365
1662025-03-21T18:38:22.641ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1672025-03-21T18:38:22.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1682025-03-21T18:38:22.641ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1692025-03-21T18:38:22.641ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
1702025-03-21T18:38:22.644ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8ee0e826-f332-45e1-aff6-9d952b81b2f2", "content-length": "124", "date": "Fri, 21 Mar 2025 18:38:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8ee0e826-f332-45e1-aff6-9d952b81b2f2" } file = sled-agent/src/ddm_reconciler.rs:193
1712025-03-21T18:38:22.644ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
1722025-03-21T18:38:22.644ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1732025-03-21T18:38:22.644ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
1742025-03-21T18:38:22.654ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_34819322-8562-4c8b-95bf-c8903d7e9c97/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-21T18:38:22.682ZINFOSledAgent: successfully created encrypted zvol: name="oxi_34819322-8562-4c8b-95bf-c8903d7e9c97/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-21T18:38:22.682ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_34819322-8562-4c8b-95bf-c8903d7e9c97/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-21T18:38:22.687ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1782025-03-21T18:38:22.687ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-21T18:38:22.687ZINFOSledAgent (BackingFs): Ensuring dataset oxi_34819322-8562-4c8b-95bf-c8903d7e9c97/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-21T18:38:22.772ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-21T18:38:22.990ZINFOSledAgent (BackingFs): Mounting oxi_34819322-8562-4c8b-95bf-c8903d7e9c97/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-21T18:38:23.003ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-21T18:38:23.003ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-21T18:38:23.003ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-21T18:38:23.003ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-21T18:38:23.758ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1872025-03-21T18:38:23.763ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:38411 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1882025-03-21T18:38:23.763ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1892025-03-21T18:38:23.763ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:38411 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1902025-03-21T18:38:23.764ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 316.818654ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1912025-03-21T18:38:23.765ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1922025-03-21T18:38:23.765ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1932025-03-21T18:38:23.765ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:981 underlay_address = fd00:1122:3344:101::1
1942025-03-21T18:38:23.765ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-21T18:38:24.083ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 508.611509ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1962025-03-21T18:38:24.594ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 575.396143ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1972025-03-21T18:38:25.171ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.345046855s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1982025-03-21T18:38:26.518ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.456095865s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
1992025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2737
2002025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2967
2012025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2607
2022025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2654
2032025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3048
2042025-03-21T18:38:26.737ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3093
2052025-03-21T18:38:26.739ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2875
2062025-03-21T18:38:26.741ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2648
2072025-03-21T18:38:26.741ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='24fa165e-a8e2-4937-8984-d45ac1d687d4'/> <propval type="astring" name="rack_id" value='824266aa-507b-4201-8ccd-ac7c6cbafcf0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe55:5ba1'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='824266aa-507b-4201-8ccd-ac7c6cbafcf0'/> <propval type="astring" name="sled_id" value='84074e7c-1a32-4c31-a122-c0b819b9b406'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='824266aa-507b-4201-8ccd-ac7c6cbafcf0'/> <propval type="astring" name="sled_id" value='84074e7c-1a32-4c31-a122-c0b819b9b406'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='84074e7c-1a32-4c31-a122-c0b819b9b406'/> <propval type="astring" name="rack_uuid" value='824266aa-507b-4201-8ccd-ac7c6cbafcf0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='84074e7c-1a32-4c31-a122-c0b819b9b406'/> <propval type="astring" name="rack_uuid" value='824266aa-507b-4201-8ccd-ac7c6cbafcf0'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2082025-03-21T18:38:26.741ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2092025-03-21T18:38:27.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 55.920874ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-21T18:38:27.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 66.107365ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-21T18:38:27.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 132.63842ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-21T18:38:27.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 445.712634ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-03-21T18:38:28.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.113017012s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2142025-03-21T18:38:29.590ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.306559397s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-21T18:38:29.976ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.177912969s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2162025-03-21T18:38:30.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 554.044418ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-21T18:38:31.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 623.239522ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-03-21T18:38:32.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2192025-03-21T18:38:32.722ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2202025-03-21T18:38:32.724ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2212025-03-21T18:38:32.724ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:423
2222025-03-21T18:38:32.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2232025-03-21T18:38:32.724ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2242025-03-21T18:38:32.724ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2252025-03-21T18:38:32.724ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2262025-03-21T18:38:32.724ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2272025-03-21T18:38:32.724ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
2282025-03-21T18:38:32.934ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:55475
2292025-03-21T18:38:32.934ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2302025-03-21T18:38:32.934ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2312025-03-21T18:38:32.939ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4343 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2322025-03-21T18:38:32.939ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4359
2332025-03-21T18:38:32.939ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2342025-03-21T18:38:33.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50859
2352025-03-21T18:38:33.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2362025-03-21T18:38:33.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2372025-03-21T18:38:33.232ZINFOSledAgent (ServiceManager): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:186
2382025-03-21T18:38:33.232ZINFOSledAgent (ServiceManager): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:186
2392025-03-21T18:38:33.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50859 req_id = c00b17b7-4bc0-4c42-bfd9-3b455ab73b6a response_code = 200 uri = /inventory
2402025-03-21T18:38:33.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56631
2412025-03-21T18:38:33.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56631 req_id = ce5fcc67-c407-4932-aebd-7002924899e9 response_code = 200 uri = /sled-role
2422025-03-21T18:38:33.296ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 070b8c52-8ea3-48a7-8314-df14a2c5cb5e (physical_disk), pool_id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4ff86e14-dcda-422b-a2fe-c5993a600493 (physical_disk), pool_id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 697ff2d8-5950-4c5f-a949-4ecafc1d823a (physical_disk), pool_id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ab1bc24c-e9d0-4b20-9d9d-faa33b91fe3b (physical_disk), pool_id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7d219a8-62e6-45f9-a3b5-e7796f298259 (physical_disk), pool_id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e600369b-ac93-4c89-b009-938e4059a81f (physical_disk), pool_id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e86aa1cf-4f67-4187-ba05-dc4ab7fb4ee5 (physical_disk), pool_id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ff157cf4-e528-42b6-b056-2b579c943c2d (physical_disk), pool_id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ffc30072-276d-4359-ac68-de853e320c0b (physical_disk), pool_id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool) }] } file = sled-agent/src/rack_setup/service.rs:399 sled_address = [fd00:1122:3344:101::1]:12345
2432025-03-21T18:38:33.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54759
2442025-03-21T18:38:33.297ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2452025-03-21T18:38:33.297ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 070b8c52-8ea3-48a7-8314-df14a2c5cb5e (physical_disk), pool_id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4ff86e14-dcda-422b-a2fe-c5993a600493 (physical_disk), pool_id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 697ff2d8-5950-4c5f-a949-4ecafc1d823a (physical_disk), pool_id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ab1bc24c-e9d0-4b20-9d9d-faa33b91fe3b (physical_disk), pool_id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: c7d219a8-62e6-45f9-a3b5-e7796f298259 (physical_disk), pool_id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e600369b-ac93-4c89-b009-938e4059a81f (physical_disk), pool_id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e86aa1cf-4f67-4187-ba05-dc4ab7fb4ee5 (physical_disk), pool_id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ff157cf4-e528-42b6-b056-2b579c943c2d (physical_disk), pool_id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ffc30072-276d-4359-ac68-de853e320c0b (physical_disk), pool_id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2462025-03-21T18:38:33.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2472025-03-21T18:38:33.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2482025-03-21T18:38:33.297ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1301 request = omicron_physical_disks_ensure
2492025-03-21T18:38:33.297ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2502025-03-21T18:38:33.297ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2512025-03-21T18:38:33.297ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2522025-03-21T18:38:33.297ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2532025-03-21T18:38:33.449ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2542025-03-21T18:38:33.449ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 2219f396-1299-4176-91e7-626a9f13bedc (zpool)
2552025-03-21T18:38:33.917ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2562025-03-21T18:38:33.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6652026618285314607 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2572025-03-21T18:38:33.918ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8789954377777244907 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2582025-03-21T18:38:34.138ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
2592025-03-21T18:38:34.192ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }
2602025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2612025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2622025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2632025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2642025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2652025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2662025-03-21T18:38:34.200ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2672025-03-21T18:38:34.245ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2682025-03-21T18:38:34.253ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone file = sled-storage/src/dataset.rs:304
2692025-03-21T18:38:34.417ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2219f396-1299-4176-91e7-626a9f13bedc file = sled-storage/src/dataset.rs:390
2702025-03-21T18:38:34.425ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2712025-03-21T18:38:34.425ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2722025-03-21T18:38:34.425ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2732025-03-21T18:38:34.425ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2742025-03-21T18:38:34.425ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2752025-03-21T18:38:34.435ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2762025-03-21T18:38:34.435ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool)
2772025-03-21T18:38:34.547ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }
2782025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2792025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2802025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2812025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2822025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2832025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2842025-03-21T18:38:34.554ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2852025-03-21T18:38:34.595ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2862025-03-21T18:38:34.604ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone file = sled-storage/src/dataset.rs:304
2872025-03-21T18:38:34.777ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe file = sled-storage/src/dataset.rs:390
2882025-03-21T18:38:34.784ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2892025-03-21T18:38:34.785ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2902025-03-21T18:38:34.785ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2912025-03-21T18:38:34.785ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922025-03-21T18:38:34.785ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2932025-03-21T18:38:34.794ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2942025-03-21T18:38:34.794ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 93f27406-584f-49b0-bbdf-aec064c7573f (zpool)
2952025-03-21T18:38:34.905ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }
2962025-03-21T18:38:34.912ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
2972025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
2982025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
2992025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3002025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3012025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3022025-03-21T18:38:34.913ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3032025-03-21T18:38:34.919ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
3042025-03-21T18:38:34.951ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3052025-03-21T18:38:34.959ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone file = sled-storage/src/dataset.rs:304
3062025-03-21T18:38:35.125ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_93f27406-584f-49b0-bbdf-aec064c7573f file = sled-storage/src/dataset.rs:390
3072025-03-21T18:38:35.133ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3082025-03-21T18:38:35.133ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3092025-03-21T18:38:35.133ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3102025-03-21T18:38:35.133ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3112025-03-21T18:38:35.133ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3122025-03-21T18:38:35.142ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3132025-03-21T18:38:35.142ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool)
3142025-03-21T18:38:35.242ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }
3152025-03-21T18:38:35.249ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3162025-03-21T18:38:35.249ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3172025-03-21T18:38:35.249ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3182025-03-21T18:38:35.249ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3192025-03-21T18:38:35.249ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3202025-03-21T18:38:35.250ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3212025-03-21T18:38:35.250ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3222025-03-21T18:38:35.292ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3232025-03-21T18:38:35.300ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone file = sled-storage/src/dataset.rs:304
3242025-03-21T18:38:35.466ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_47056192-ed60-41f0-aecf-23ae41e9cb50 file = sled-storage/src/dataset.rs:390
3252025-03-21T18:38:35.474ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3262025-03-21T18:38:35.474ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3272025-03-21T18:38:35.474ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3282025-03-21T18:38:35.474ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3292025-03-21T18:38:35.474ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3302025-03-21T18:38:35.483ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3312025-03-21T18:38:35.483ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool)
3322025-03-21T18:38:35.591ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }
3332025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3342025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3352025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3362025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3372025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3382025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3392025-03-21T18:38:35.599ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3402025-03-21T18:38:35.639ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3412025-03-21T18:38:35.647ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/zone file = sled-storage/src/dataset.rs:304
3422025-03-21T18:38:35.814ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb file = sled-storage/src/dataset.rs:390
3432025-03-21T18:38:35.822ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3442025-03-21T18:38:35.822ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3452025-03-21T18:38:35.822ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3462025-03-21T18:38:35.822ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3472025-03-21T18:38:35.822ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3482025-03-21T18:38:35.832ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3492025-03-21T18:38:35.832ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool)
3502025-03-21T18:38:35.940ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }
3512025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3522025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3532025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3542025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3552025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3562025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3572025-03-21T18:38:35.948ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3582025-03-21T18:38:35.951ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
3592025-03-21T18:38:35.985ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3602025-03-21T18:38:35.992ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/zone file = sled-storage/src/dataset.rs:304
3612025-03-21T18:38:36.153ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba file = sled-storage/src/dataset.rs:390
3622025-03-21T18:38:36.160ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3632025-03-21T18:38:36.160ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3642025-03-21T18:38:36.160ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3652025-03-21T18:38:36.160ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3662025-03-21T18:38:36.160ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3672025-03-21T18:38:36.170ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3682025-03-21T18:38:36.170ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool)
3692025-03-21T18:38:36.277ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }
3702025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3712025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3722025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3732025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3742025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3752025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3762025-03-21T18:38:36.285ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3772025-03-21T18:38:36.325ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3782025-03-21T18:38:36.332ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone file = sled-storage/src/dataset.rs:304
3792025-03-21T18:38:36.511ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9 file = sled-storage/src/dataset.rs:390
3802025-03-21T18:38:36.519ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3812025-03-21T18:38:36.520ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3822025-03-21T18:38:36.520ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3832025-03-21T18:38:36.520ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3842025-03-21T18:38:36.520ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3852025-03-21T18:38:36.529ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3862025-03-21T18:38:36.529ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 71dc428d-9d1f-483c-b923-af3efe9583af (zpool)
3872025-03-21T18:38:36.636ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }
3882025-03-21T18:38:36.645ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3892025-03-21T18:38:36.645ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3902025-03-21T18:38:36.645ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3912025-03-21T18:38:36.645ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3922025-03-21T18:38:36.645ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3932025-03-21T18:38:36.646ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3942025-03-21T18:38:36.646ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3952025-03-21T18:38:36.687ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962025-03-21T18:38:36.695ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone file = sled-storage/src/dataset.rs:304
3972025-03-21T18:38:36.863ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_71dc428d-9d1f-483c-b923-af3efe9583af file = sled-storage/src/dataset.rs:390
3982025-03-21T18:38:36.871ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
3992025-03-21T18:38:36.871ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4002025-03-21T18:38:36.871ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4012025-03-21T18:38:36.871ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4022025-03-21T18:38:36.871ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4032025-03-21T18:38:36.882ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4042025-03-21T18:38:36.882ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 746ded48-1093-4fb4-a064-8507518ef38c (zpool)
4052025-03-21T18:38:36.998ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }
4062025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4072025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4082025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4092025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4102025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4122025-03-21T18:38:37.005ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4132025-03-21T18:38:37.009ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4142025-03-21T18:38:37.046ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4152025-03-21T18:38:37.054ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone file = sled-storage/src/dataset.rs:304
4162025-03-21T18:38:37.220ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_746ded48-1093-4fb4-a064-8507518ef38c file = sled-storage/src/dataset.rs:390
4172025-03-21T18:38:37.228ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4182025-03-21T18:38:37.228ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4192025-03-21T18:38:37.228ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4202025-03-21T18:38:37.229ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34819322-8562-4c8b-95bf-c8903d7e9c97 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eabe7796-89f9-4e63-b1df-63201e46213d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4212025-03-21T18:38:37.229ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4222025-03-21T18:38:37.229ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4232025-03-21T18:38:37.229ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4242025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4252025-03-21T18:38:37.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4262025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4272025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4282025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4292025-03-21T18:38:37.229ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4302025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4312025-03-21T18:38:37.229ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4322025-03-21T18:38:37.229ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4332025-03-21T18:38:37.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3932933 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54759 req_id = 8f3a766f-9c4e-4e05-8cbd-deb9112fc8c1 response_code = 200 uri = /omicron-physical-disks
4342025-03-21T18:38:37.261ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01839dc2-e5e0-478b-a06e-f6aac9900260 (dataset): DatasetConfig { id: 01839dc2-e5e0-478b-a06e-f6aac9900260 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01d68d5f-7fc9-4e91-9323-3d21628d4913 (dataset): DatasetConfig { id: 01d68d5f-7fc9-4e91-9323-3d21628d4913 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 039e17c6-717a-4d0d-b4b2-3ef4a3e1471b (dataset): DatasetConfig { id: 039e17c6-717a-4d0d-b4b2-3ef4a3e1471b (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 05931881-5c40-4a47-8b1b-6660f08bb2ec (dataset): DatasetConfig { id: 05931881-5c40-4a47-8b1b-6660f08bb2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06573d30-bab8-4a88-8699-71b0851e5ea6 (dataset): DatasetConfig { id: 06573d30-bab8-4a88-8699-71b0851e5ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0aef3d40-4147-4800-b903-59e88c4a6922 (dataset): DatasetConfig { id: 0aef3d40-4147-4800-b903-59e88c4a6922 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0c7675b2-dff2-42a8-8267-50a0f4bc2ec5 (dataset): DatasetConfig { id: 0c7675b2-dff2-42a8-8267-50a0f4bc2ec5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dbf158a-56bf-41ab-b31b-ec4cc57dbeb4 (dataset): DatasetConfig { id: 0dbf158a-56bf-41ab-b31b-ec4cc57dbeb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10240848-6ff5-4fe2-8add-6687444473cd (dataset): DatasetConfig { id: 10240848-6ff5-4fe2-8add-6687444473cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 138266da-d090-49f2-a3f0-d81519d11280 (dataset): DatasetConfig { id: 138266da-d090-49f2-a3f0-d81519d11280 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1456c379-7a52-44f8-acb4-84ae2fc5ab38 (dataset): DatasetConfig { id: 1456c379-7a52-44f8-acb4-84ae2fc5ab38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2015dad6-41a9-47a0-aaae-881c64677195 (dataset): DatasetConfig { id: 2015dad6-41a9-47a0-aaae-881c64677195 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a79e605-3388-4e5b-a4c0-1321435d8fbb (dataset): DatasetConfig { id: 2a79e605-3388-4e5b-a4c0-1321435d8fbb (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 329697ca-17af-4a5b-bc36-4f52177b7daf (dataset): DatasetConfig { id: 329697ca-17af-4a5b-bc36-4f52177b7daf (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3519c622-83df-44f4-920a-de8e88716430 (dataset): DatasetConfig { id: 3519c622-83df-44f4-920a-de8e88716430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36c0c108-da62-4577-8d53-806a6de5ae96 (dataset): DatasetConfig { id: 36c0c108-da62-4577-8d53-806a6de5ae96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36f6e3de-fa06-4236-8ed8-fdee771c19b7 (dataset): DatasetConfig { id: 36f6e3de-fa06-4236-8ed8-fdee771c19b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39115fb5-f27c-4660-bbbf-a1ac85dc2657 (dataset): DatasetConfig { id: 39115fb5-f27c-4660-bbbf-a1ac85dc2657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b4149e3-be86-4a74-bc05-731a3cd52671 (dataset): DatasetConfig { id: 3b4149e3-be86-4a74-bc05-731a3cd52671 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3d608902-c642-4e5c-8d3d-f0a346d25252 (dataset): DatasetConfig { id: 3d608902-c642-4e5c-8d3d-f0a346d25252 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42002dd1-b64b-4b03-8baf-1e78d0a8e4b4 (dataset): DatasetConfig { id: 42002dd1-b64b-4b03-8baf-1e78d0a8e4b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42502876-4477-4ebf-b985-6255cd0fcd00 (dataset): DatasetConfig { id: 42502876-4477-4ebf-b985-6255cd0fcd00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44f196b3-b1b5-43cb-8f96-a2fae6459dc4 (dataset): DatasetConfig { id: 44f196b3-b1b5-43cb-8f96-a2fae6459dc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 473365ef-57f4-4684-955d-5839a3948cba (dataset): DatasetConfig { id: 473365ef-57f4-4684-955d-5839a3948cba (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d68d720-fb90-4dbe-8a1c-1323119fe4be (dataset): DatasetConfig { id: 5d68d720-fb90-4dbe-8a1c-1323119fe4be (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f1610b2-8fd7-4cf5-8c28-811a45cd7f31 (dataset): DatasetConfig { id: 5f1610b2-8fd7-4cf5-8c28-811a45cd7f31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 601807a4-a4ac-4b72-9a32-8229571dda19 (dataset): DatasetConfig { id: 601807a4-a4ac-4b72-9a32-8229571dda19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f8a4c7-d10d-48a6-8602-3d53a0c2052e (dataset): DatasetConfig { id: 61f8a4c7-d10d-48a6-8602-3d53a0c2052e (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64e8a212-0727-4eb4-bd06-4e95aef933e3 (dataset): DatasetConfig { id: 64e8a212-0727-4eb4-bd06-4e95aef933e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 650520d2-d50a-4d46-8f63-461a2e06adc6 (dataset): DatasetConfig { id: 650520d2-d50a-4d46-8f63-461a2e06adc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68cfb434-ede6-4a8f-9c7c-4aaae95fbef3 (dataset): DatasetConfig { id: 68cfb434-ede6-4a8f-9c7c-4aaae95fbef3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ca4443b-0169-44d0-a299-8a9d2716b70f (dataset): DatasetConfig { id: 6ca4443b-0169-44d0-a299-8a9d2716b70f (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70e2b877-5963-4617-b60c-bc97eb156e9b (dataset): DatasetConfig { id: 70e2b877-5963-4617-b60c-bc97eb156e9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71842b08-5bf9-48ea-85e3-ec580a92651a (dataset): DatasetConfig { id: 71842b08-5bf9-48ea-85e3-ec580a92651a (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7817a43d-365c-41fe-806f-e41c342e6ef9 (dataset): DatasetConfig { id: 7817a43d-365c-41fe-806f-e41c342e6ef9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79bef82a-f1ba-44f5-8e4d-6a1195ee60b5 (dataset): DatasetConfig { id: 79bef82a-f1ba-44f5-8e4d-6a1195ee60b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81d6d277-104c-4734-b59a-a6e1b1046391 (dataset): DatasetConfig { id: 81d6d277-104c-4734-b59a-a6e1b1046391 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 831191e1-ad0d-43e9-a073-30ef3619a8fe (dataset): DatasetConfig { id: 831191e1-ad0d-43e9-a073-30ef3619a8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8971a554-ef9c-4b5e-9864-a8cd7a0b5d67 (dataset): DatasetConfig { id: 8971a554-ef9c-4b5e-9864-a8cd7a0b5d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 900bb9bf-8323-48ea-9e00-e047eb65c684 (dataset): DatasetConfig { id: 900bb9bf-8323-48ea-9e00-e047eb65c684 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1c0c959-8abe-472d-980e-246e98cc0c13 (dataset): DatasetConfig { id: a1c0c959-8abe-472d-980e-246e98cc0c13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b3cf257c-2c34-450d-a363-6a107b418735 (dataset): DatasetConfig { id: b3cf257c-2c34-450d-a363-6a107b418735 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8706509-8a87-4d33-9632-4f344fd9390d (dataset): DatasetConfig { id: b8706509-8a87-4d33-9632-4f344fd9390d (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bacb6877-5bdd-4def-94ac-a1d2a9b66c49 (dataset): DatasetConfig { id: bacb6877-5bdd-4def-94ac-a1d2a9b66c49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcbdeaaf-3599-4c20-be37-df535fcc2bae (dataset): DatasetConfig { id: bcbdeaaf-3599-4c20-be37-df535fcc2bae (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c71f79ac-4b32-46d6-a83d-5abba05969d5 (dataset): DatasetConfig { id: c71f79ac-4b32-46d6-a83d-5abba05969d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c804dc93-e13e-42e3-a5cc-06a5fce2151f (dataset): DatasetConfig { id: c804dc93-e13e-42e3-a5cc-06a5fce2151f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c96a5ee2-b46d-4541-85f8-feb70f5ba144 (dataset): DatasetConfig { id: c96a5ee2-b46d-4541-85f8-feb70f5ba144 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ab0104-ee75-4e53-b87a-366f708c2865 (dataset): DatasetConfig { id: d0ab0104-ee75-4e53-b87a-366f708c2865 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0b6a77c-e64b-45a3-9f56-8b58f848d68f (dataset): DatasetConfig { id: d0b6a77c-e64b-45a3-9f56-8b58f848d68f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c00902-8c1f-4871-9b22-f8bb40ebe1c1 (dataset): DatasetConfig { id: d0c00902-8c1f-4871-9b22-f8bb40ebe1c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d11ccc30-134b-4cc9-89ae-3a42f4fcc24b (dataset): DatasetConfig { id: d11ccc30-134b-4cc9-89ae-3a42f4fcc24b (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d16f7754-e385-4ab4-bd3d-1b389f0f8a0a (dataset): DatasetConfig { id: d16f7754-e385-4ab4-bd3d-1b389f0f8a0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d35dffb3-1e27-4b9d-9328-5a86256cff0c (dataset): DatasetConfig { id: d35dffb3-1e27-4b9d-9328-5a86256cff0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d4d0250b-0cdb-48cb-9eaa-e09ef40ee6de (dataset): DatasetConfig { id: d4d0250b-0cdb-48cb-9eaa-e09ef40ee6de (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4fc82a6-f401-4d21-aeb2-9ab13fe29ffa (dataset): DatasetConfig { id: d4fc82a6-f401-4d21-aeb2-9ab13fe29ffa (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0c43e64-f4f6-4166-b661-b40c0ee28761 (dataset): DatasetConfig { id: e0c43e64-f4f6-4166-b661-b40c0ee28761 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e599cb99-97bf-419f-a2da-c554396ce2c7 (dataset): DatasetConfig { id: e599cb99-97bf-419f-a2da-c554396ce2c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5b3e8aa-dc79-4dd9-9bcf-c2319787626e (dataset): DatasetConfig { id: e5b3e8aa-dc79-4dd9-9bcf-c2319787626e (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec0b4f3b-39e1-441f-a9ac-0dcb2ba34809 (dataset): DatasetConfig { id: ec0b4f3b-39e1-441f-a9ac-0dcb2ba34809 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efbb5769-df32-4c39-98c8-a073049a992b (dataset): DatasetConfig { id: efbb5769-df32-4c39-98c8-a073049a992b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5323447-c64b-4af3-b0b6-1f80d433d65b (dataset): DatasetConfig { id: f5323447-c64b-4af3-b0b6-1f80d433d65b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f7dfd2a7-1e61-400d-8c35-9101174b27e4 (dataset): DatasetConfig { id: f7dfd2a7-1e61-400d-8c35-9101174b27e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9b25d01-3223-45e7-a9e9-3216f90a8f8b (dataset): DatasetConfig { id: f9b25d01-3223-45e7-a9e9-3216f90a8f8b (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fac27fd2-0e07-4828-9099-1236f0852925 (dataset): DatasetConfig { id: fac27fd2-0e07-4828-9099-1236f0852925 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd05fa74-b710-4926-9d9f-b61ab4b58947 (dataset): DatasetConfig { id: fd05fa74-b710-4926-9d9f-b61ab4b58947 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:527 sled_address = [fd00:1122:3344:101::1]:12345
4352025-03-21T18:38:37.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36727
4362025-03-21T18:38:37.262ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4372025-03-21T18:38:37.262ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01839dc2-e5e0-478b-a06e-f6aac9900260 (dataset): DatasetConfig { id: 01839dc2-e5e0-478b-a06e-f6aac9900260 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01d68d5f-7fc9-4e91-9323-3d21628d4913 (dataset): DatasetConfig { id: 01d68d5f-7fc9-4e91-9323-3d21628d4913 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 039e17c6-717a-4d0d-b4b2-3ef4a3e1471b (dataset): DatasetConfig { id: 039e17c6-717a-4d0d-b4b2-3ef4a3e1471b (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 05931881-5c40-4a47-8b1b-6660f08bb2ec (dataset): DatasetConfig { id: 05931881-5c40-4a47-8b1b-6660f08bb2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06573d30-bab8-4a88-8699-71b0851e5ea6 (dataset): DatasetConfig { id: 06573d30-bab8-4a88-8699-71b0851e5ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0aef3d40-4147-4800-b903-59e88c4a6922 (dataset): DatasetConfig { id: 0aef3d40-4147-4800-b903-59e88c4a6922 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0c7675b2-dff2-42a8-8267-50a0f4bc2ec5 (dataset): DatasetConfig { id: 0c7675b2-dff2-42a8-8267-50a0f4bc2ec5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dbf158a-56bf-41ab-b31b-ec4cc57dbeb4 (dataset): DatasetConfig { id: 0dbf158a-56bf-41ab-b31b-ec4cc57dbeb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10240848-6ff5-4fe2-8add-6687444473cd (dataset): DatasetConfig { id: 10240848-6ff5-4fe2-8add-6687444473cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 138266da-d090-49f2-a3f0-d81519d11280 (dataset): DatasetConfig { id: 138266da-d090-49f2-a3f0-d81519d11280 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1456c379-7a52-44f8-acb4-84ae2fc5ab38 (dataset): DatasetConfig { id: 1456c379-7a52-44f8-acb4-84ae2fc5ab38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2015dad6-41a9-47a0-aaae-881c64677195 (dataset): DatasetConfig { id: 2015dad6-41a9-47a0-aaae-881c64677195 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a79e605-3388-4e5b-a4c0-1321435d8fbb (dataset): DatasetConfig { id: 2a79e605-3388-4e5b-a4c0-1321435d8fbb (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 329697ca-17af-4a5b-bc36-4f52177b7daf (dataset): DatasetConfig { id: 329697ca-17af-4a5b-bc36-4f52177b7daf (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3519c622-83df-44f4-920a-de8e88716430 (dataset): DatasetConfig { id: 3519c622-83df-44f4-920a-de8e88716430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36c0c108-da62-4577-8d53-806a6de5ae96 (dataset): DatasetConfig { id: 36c0c108-da62-4577-8d53-806a6de5ae96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36f6e3de-fa06-4236-8ed8-fdee771c19b7 (dataset): DatasetConfig { id: 36f6e3de-fa06-4236-8ed8-fdee771c19b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39115fb5-f27c-4660-bbbf-a1ac85dc2657 (dataset): DatasetConfig { id: 39115fb5-f27c-4660-bbbf-a1ac85dc2657 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b4149e3-be86-4a74-bc05-731a3cd52671 (dataset): DatasetConfig { id: 3b4149e3-be86-4a74-bc05-731a3cd52671 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3d608902-c642-4e5c-8d3d-f0a346d25252 (dataset): DatasetConfig { id: 3d608902-c642-4e5c-8d3d-f0a346d25252 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42002dd1-b64b-4b03-8baf-1e78d0a8e4b4 (dataset): DatasetConfig { id: 42002dd1-b64b-4b03-8baf-1e78d0a8e4b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42502876-4477-4ebf-b985-6255cd0fcd00 (dataset): DatasetConfig { id: 42502876-4477-4ebf-b985-6255cd0fcd00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44f196b3-b1b5-43cb-8f96-a2fae6459dc4 (dataset): DatasetConfig { id: 44f196b3-b1b5-43cb-8f96-a2fae6459dc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 473365ef-57f4-4684-955d-5839a3948cba (dataset): DatasetConfig { id: 473365ef-57f4-4684-955d-5839a3948cba (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d68d720-fb90-4dbe-8a1c-1323119fe4be (dataset): DatasetConfig { id: 5d68d720-fb90-4dbe-8a1c-1323119fe4be (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f1610b2-8fd7-4cf5-8c28-811a45cd7f31 (dataset): DatasetConfig { id: 5f1610b2-8fd7-4cf5-8c28-811a45cd7f31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 601807a4-a4ac-4b72-9a32-8229571dda19 (dataset): DatasetConfig { id: 601807a4-a4ac-4b72-9a32-8229571dda19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f8a4c7-d10d-48a6-8602-3d53a0c2052e (dataset): DatasetConfig { id: 61f8a4c7-d10d-48a6-8602-3d53a0c2052e (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64e8a212-0727-4eb4-bd06-4e95aef933e3 (dataset): DatasetConfig { id: 64e8a212-0727-4eb4-bd06-4e95aef933e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 650520d2-d50a-4d46-8f63-461a2e06adc6 (dataset): DatasetConfig { id: 650520d2-d50a-4d46-8f63-461a2e06adc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68cfb434-ede6-4a8f-9c7c-4aaae95fbef3 (dataset): DatasetConfig { id: 68cfb434-ede6-4a8f-9c7c-4aaae95fbef3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ca4443b-0169-44d0-a299-8a9d2716b70f (dataset): DatasetConfig { id: 6ca4443b-0169-44d0-a299-8a9d2716b70f (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70e2b877-5963-4617-b60c-bc97eb156e9b (dataset): DatasetConfig { id: 70e2b877-5963-4617-b60c-bc97eb156e9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71842b08-5bf9-48ea-85e3-ec580a92651a (dataset): DatasetConfig { id: 71842b08-5bf9-48ea-85e3-ec580a92651a (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7817a43d-365c-41fe-806f-e41c342e6ef9 (dataset): DatasetConfig { id: 7817a43d-365c-41fe-806f-e41c342e6ef9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79bef82a-f1ba-44f5-8e4d-6a1195ee60b5 (dataset): DatasetConfig { id: 79bef82a-f1ba-44f5-8e4d-6a1195ee60b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81d6d277-104c-4734-b59a-a6e1b1046391 (dataset): DatasetConfig { id: 81d6d277-104c-4734-b59a-a6e1b1046391 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 831191e1-ad0d-43e9-a073-30ef3619a8fe (dataset): DatasetConfig { id: 831191e1-ad0d-43e9-a073-30ef3619a8fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8971a554-ef9c-4b5e-9864-a8cd7a0b5d67 (dataset): DatasetConfig { id: 8971a554-ef9c-4b5e-9864-a8cd7a0b5d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 900bb9bf-8323-48ea-9e00-e047eb65c684 (dataset): DatasetConfig { id: 900bb9bf-8323-48ea-9e00-e047eb65c684 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1c0c959-8abe-472d-980e-246e98cc0c13 (dataset): DatasetConfig { id: a1c0c959-8abe-472d-980e-246e98cc0c13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b3cf257c-2c34-450d-a363-6a107b418735 (dataset): DatasetConfig { id: b3cf257c-2c34-450d-a363-6a107b418735 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8706509-8a87-4d33-9632-4f344fd9390d (dataset): DatasetConfig { id: b8706509-8a87-4d33-9632-4f344fd9390d (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bacb6877-5bdd-4def-94ac-a1d2a9b66c49 (dataset): DatasetConfig { id: bacb6877-5bdd-4def-94ac-a1d2a9b66c49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcbdeaaf-3599-4c20-be37-df535fcc2bae (dataset): DatasetConfig { id: bcbdeaaf-3599-4c20-be37-df535fcc2bae (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c71f79ac-4b32-46d6-a83d-5abba05969d5 (dataset): DatasetConfig { id: c71f79ac-4b32-46d6-a83d-5abba05969d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c804dc93-e13e-42e3-a5cc-06a5fce2151f (dataset): DatasetConfig { id: c804dc93-e13e-42e3-a5cc-06a5fce2151f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c96a5ee2-b46d-4541-85f8-feb70f5ba144 (dataset): DatasetConfig { id: c96a5ee2-b46d-4541-85f8-feb70f5ba144 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ab0104-ee75-4e53-b87a-366f708c2865 (dataset): DatasetConfig { id: d0ab0104-ee75-4e53-b87a-366f708c2865 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0b6a77c-e64b-45a3-9f56-8b58f848d68f (dataset): DatasetConfig { id: d0b6a77c-e64b-45a3-9f56-8b58f848d68f (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c00902-8c1f-4871-9b22-f8bb40ebe1c1 (dataset): DatasetConfig { id: d0c00902-8c1f-4871-9b22-f8bb40ebe1c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d11ccc30-134b-4cc9-89ae-3a42f4fcc24b (dataset): DatasetConfig { id: d11ccc30-134b-4cc9-89ae-3a42f4fcc24b (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d16f7754-e385-4ab4-bd3d-1b389f0f8a0a (dataset): DatasetConfig { id: d16f7754-e385-4ab4-bd3d-1b389f0f8a0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d35dffb3-1e27-4b9d-9328-5a86256cff0c (dataset): DatasetConfig { id: d35dffb3-1e27-4b9d-9328-5a86256cff0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d4d0250b-0cdb-48cb-9eaa-e09ef40ee6de (dataset): DatasetConfig { id: d4d0250b-0cdb-48cb-9eaa-e09ef40ee6de (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4fc82a6-f401-4d21-aeb2-9ab13fe29ffa (dataset): DatasetConfig { id: d4fc82a6-f401-4d21-aeb2-9ab13fe29ffa (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0c43e64-f4f6-4166-b661-b40c0ee28761 (dataset): DatasetConfig { id: e0c43e64-f4f6-4166-b661-b40c0ee28761 (dataset), name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e599cb99-97bf-419f-a2da-c554396ce2c7 (dataset): DatasetConfig { id: e599cb99-97bf-419f-a2da-c554396ce2c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5b3e8aa-dc79-4dd9-9bcf-c2319787626e (dataset): DatasetConfig { id: e5b3e8aa-dc79-4dd9-9bcf-c2319787626e (dataset), name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec0b4f3b-39e1-441f-a9ac-0dcb2ba34809 (dataset): DatasetConfig { id: ec0b4f3b-39e1-441f-a9ac-0dcb2ba34809 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efbb5769-df32-4c39-98c8-a073049a992b (dataset): DatasetConfig { id: efbb5769-df32-4c39-98c8-a073049a992b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5323447-c64b-4af3-b0b6-1f80d433d65b (dataset): DatasetConfig { id: f5323447-c64b-4af3-b0b6-1f80d433d65b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f7dfd2a7-1e61-400d-8c35-9101174b27e4 (dataset): DatasetConfig { id: f7dfd2a7-1e61-400d-8c35-9101174b27e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9b25d01-3223-45e7-a9e9-3216f90a8f8b (dataset): DatasetConfig { id: f9b25d01-3223-45e7-a9e9-3216f90a8f8b (dataset), name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fac27fd2-0e07-4828-9099-1236f0852925 (dataset): DatasetConfig { id: fac27fd2-0e07-4828-9099-1236f0852925 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd05fa74-b710-4926-9d9f-b61ab4b58947 (dataset): DatasetConfig { id: fd05fa74-b710-4926-9d9f-b61ab4b58947 (dataset), name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4382025-03-21T18:38:37.262ZINFOSledAgent (StorageManager): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-21T18:38:37.262ZINFOSledAgent (StorageManager): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4402025-03-21T18:38:37.262ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4412025-03-21T18:38:37.278ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4422025-03-21T18:38:37.278ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4432025-03-21T18:38:37.278ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30" } file = sled-storage/src/manager.rs:1433
4442025-03-21T18:38:37.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4452025-03-21T18:38:37.351ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4462025-03-21T18:38:37.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4472025-03-21T18:38:37.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4482025-03-21T18:38:37.413ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4492025-03-21T18:38:37.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/debug"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/debug" } file = sled-storage/src/manager.rs:1433
4502025-03-21T18:38:37.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4512025-03-21T18:38:37.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4522025-03-21T18:38:37.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crucible" } file = sled-storage/src/manager.rs:1433
4532025-03-21T18:38:37.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4542025-03-21T18:38:37.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4552025-03-21T18:38:37.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4562025-03-21T18:38:37.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4572025-03-21T18:38:37.581ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4582025-03-21T18:38:37.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/debug"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/debug" } file = sled-storage/src/manager.rs:1433
4592025-03-21T18:38:37.620ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4602025-03-21T18:38:37.620ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4612025-03-21T18:38:37.620ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crucible" } file = sled-storage/src/manager.rs:1433
4622025-03-21T18:38:37.684ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4632025-03-21T18:38:37.684ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4642025-03-21T18:38:37.684ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0" } file = sled-storage/src/manager.rs:1433
4652025-03-21T18:38:37.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4662025-03-21T18:38:37.756ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4672025-03-21T18:38:37.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crucible" } file = sled-storage/src/manager.rs:1433
4682025-03-21T18:38:37.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4692025-03-21T18:38:37.817ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4702025-03-21T18:38:37.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4712025-03-21T18:38:37.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-21T18:38:37.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4732025-03-21T18:38:37.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e" } file = sled-storage/src/manager.rs:1433
4742025-03-21T18:38:37.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-21T18:38:37.955ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4762025-03-21T18:38:37.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone" } file = sled-storage/src/manager.rs:1433
4772025-03-21T18:38:37.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-21T18:38:37.992ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4792025-03-21T18:38:37.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786" } file = sled-storage/src/manager.rs:1433
4802025-03-21T18:38:38.011ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
4812025-03-21T18:38:38.064ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4822025-03-21T18:38:38.064ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4832025-03-21T18:38:38.064ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16" } file = sled-storage/src/manager.rs:1433
4842025-03-21T18:38:38.137ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4852025-03-21T18:38:38.137ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4862025-03-21T18:38:38.138ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8" } file = sled-storage/src/manager.rs:1433
4872025-03-21T18:38:38.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4882025-03-21T18:38:38.211ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4892025-03-21T18:38:38.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/zone/oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493"), full_name: "oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/zone/oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493" } file = sled-storage/src/manager.rs:1433
4902025-03-21T18:38:38.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4912025-03-21T18:38:38.284ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4922025-03-21T18:38:38.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f" } file = sled-storage/src/manager.rs:1433
4932025-03-21T18:38:38.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4942025-03-21T18:38:38.357ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4952025-03-21T18:38:38.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3" } file = sled-storage/src/manager.rs:1433
4962025-03-21T18:38:38.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4972025-03-21T18:38:38.429ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4982025-03-21T18:38:38.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/debug"), full_name: "oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/debug" } file = sled-storage/src/manager.rs:1433
4992025-03-21T18:38:38.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5002025-03-21T18:38:38.467ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5012025-03-21T18:38:38.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9" } file = sled-storage/src/manager.rs:1433
5022025-03-21T18:38:38.540ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5032025-03-21T18:38:38.540ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5042025-03-21T18:38:38.540ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crucible" } file = sled-storage/src/manager.rs:1433
5052025-03-21T18:38:38.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5062025-03-21T18:38:38.602ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5072025-03-21T18:38:38.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone"), full_name: "oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone" } file = sled-storage/src/manager.rs:1433
5082025-03-21T18:38:38.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5092025-03-21T18:38:38.639ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5102025-03-21T18:38:38.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf" } file = sled-storage/src/manager.rs:1433
5112025-03-21T18:38:38.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5122025-03-21T18:38:38.711ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5132025-03-21T18:38:38.711ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crucible" } file = sled-storage/src/manager.rs:1433
5142025-03-21T18:38:38.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5152025-03-21T18:38:38.775ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5162025-03-21T18:38:38.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone" } file = sled-storage/src/manager.rs:1433
5172025-03-21T18:38:38.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5182025-03-21T18:38:38.815ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5192025-03-21T18:38:38.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone" } file = sled-storage/src/manager.rs:1433
5202025-03-21T18:38:38.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5212025-03-21T18:38:38.852ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5222025-03-21T18:38:38.852ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76" } file = sled-storage/src/manager.rs:1433
5232025-03-21T18:38:38.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5242025-03-21T18:38:38.927ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5252025-03-21T18:38:38.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17" } file = sled-storage/src/manager.rs:1433
5262025-03-21T18:38:38.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5272025-03-21T18:38:38.998ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5282025-03-21T18:38:38.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5292025-03-21T18:38:39.013ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
5302025-03-21T18:38:39.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5312025-03-21T18:38:39.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5322025-03-21T18:38:39.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone/oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91"), full_name: "oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone/oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91" } file = sled-storage/src/manager.rs:1433
5332025-03-21T18:38:39.137ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5342025-03-21T18:38:39.137ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5352025-03-21T18:38:39.137ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357" } file = sled-storage/src/manager.rs:1433
5362025-03-21T18:38:39.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5372025-03-21T18:38:39.210ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5382025-03-21T18:38:39.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone" } file = sled-storage/src/manager.rs:1433
5392025-03-21T18:38:39.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5402025-03-21T18:38:39.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5412025-03-21T18:38:39.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone/oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e"), full_name: "oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crypt/zone/oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e" } file = sled-storage/src/manager.rs:1433
5422025-03-21T18:38:39.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5432025-03-21T18:38:39.322ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5442025-03-21T18:38:39.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/clickhouse" } file = sled-storage/src/manager.rs:1433
5452025-03-21T18:38:39.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5462025-03-21T18:38:39.386ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5472025-03-21T18:38:39.386ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/zone/oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034"), full_name: "oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/zone/oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034" } file = sled-storage/src/manager.rs:1433
5482025-03-21T18:38:39.462ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5492025-03-21T18:38:39.462ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5502025-03-21T18:38:39.462ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible" } file = sled-storage/src/manager.rs:1433
5512025-03-21T18:38:39.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5522025-03-21T18:38:39.523ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5532025-03-21T18:38:39.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9" } file = sled-storage/src/manager.rs:1433
5542025-03-21T18:38:39.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5552025-03-21T18:38:39.598ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5562025-03-21T18:38:39.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/debug"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/debug" } file = sled-storage/src/manager.rs:1433
5572025-03-21T18:38:39.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5582025-03-21T18:38:39.634ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5592025-03-21T18:38:39.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/debug"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/debug" } file = sled-storage/src/manager.rs:1433
5602025-03-21T18:38:39.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5612025-03-21T18:38:39.674ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5622025-03-21T18:38:39.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5632025-03-21T18:38:39.740ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5642025-03-21T18:38:39.740ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5652025-03-21T18:38:39.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71dc428d-9d1f-483c-b923-af3efe9583af/crypt/debug"), full_name: "oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crypt/debug" } file = sled-storage/src/manager.rs:1433
5662025-03-21T18:38:39.777ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5672025-03-21T18:38:39.777ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5682025-03-21T18:38:39.777ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5692025-03-21T18:38:39.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5702025-03-21T18:38:39.841ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5712025-03-21T18:38:39.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
5722025-03-21T18:38:39.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5732025-03-21T18:38:39.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5742025-03-21T18:38:39.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crucible" } file = sled-storage/src/manager.rs:1433
5752025-03-21T18:38:39.965ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5762025-03-21T18:38:39.965ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5772025-03-21T18:38:39.965ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775" } file = sled-storage/src/manager.rs:1433
5782025-03-21T18:38:40.015ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
5792025-03-21T18:38:40.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5802025-03-21T18:38:40.041ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5812025-03-21T18:38:40.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5822025-03-21T18:38:40.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5832025-03-21T18:38:40.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5842025-03-21T18:38:40.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41" } file = sled-storage/src/manager.rs:1433
5852025-03-21T18:38:40.156ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 21.585363919s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
5862025-03-21T18:38:40.179ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5872025-03-21T18:38:40.179ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5882025-03-21T18:38:40.179ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5892025-03-21T18:38:40.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5902025-03-21T18:38:40.243ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5912025-03-21T18:38:40.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone" } file = sled-storage/src/manager.rs:1433
5922025-03-21T18:38:40.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5932025-03-21T18:38:40.283ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5942025-03-21T18:38:40.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/zone/oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330" } file = sled-storage/src/manager.rs:1433
5952025-03-21T18:38:40.355ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5962025-03-21T18:38:40.355ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5972025-03-21T18:38:40.355ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/zone/oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b" } file = sled-storage/src/manager.rs:1433
5982025-03-21T18:38:40.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5992025-03-21T18:38:40.428ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6002025-03-21T18:38:40.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone" } file = sled-storage/src/manager.rs:1433
6012025-03-21T18:38:40.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6022025-03-21T18:38:40.466ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6032025-03-21T18:38:40.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
6042025-03-21T18:38:40.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6052025-03-21T18:38:40.530ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6062025-03-21T18:38:40.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/debug"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/debug" } file = sled-storage/src/manager.rs:1433
6072025-03-21T18:38:40.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6082025-03-21T18:38:40.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6092025-03-21T18:38:40.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2" } file = sled-storage/src/manager.rs:1433
6102025-03-21T18:38:40.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6112025-03-21T18:38:40.646ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6122025-03-21T18:38:40.646ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/zone"), full_name: "oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/zone" } file = sled-storage/src/manager.rs:1433
6132025-03-21T18:38:40.690ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6142025-03-21T18:38:40.690ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6152025-03-21T18:38:40.690ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crucible" } file = sled-storage/src/manager.rs:1433
6162025-03-21T18:38:40.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6172025-03-21T18:38:40.757ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6182025-03-21T18:38:40.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/debug"), full_name: "oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/debug" } file = sled-storage/src/manager.rs:1433
6192025-03-21T18:38:40.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6202025-03-21T18:38:40.795ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6212025-03-21T18:38:40.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0"), full_name: "oxp_746ded48-1093-4fb4-a064-8507518ef38c/crypt/zone/oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0" } file = sled-storage/src/manager.rs:1433
6222025-03-21T18:38:40.870ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6232025-03-21T18:38:40.870ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6242025-03-21T18:38:40.870ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5"), full_name: "oxp_2219f396-1299-4176-91e7-626a9f13bedc/crypt/zone/oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5" } file = sled-storage/src/manager.rs:1433
6252025-03-21T18:38:40.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6262025-03-21T18:38:40.945ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6272025-03-21T18:38:40.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/zone"), full_name: "oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/zone" } file = sled-storage/src/manager.rs:1433
6282025-03-21T18:38:40.983ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6292025-03-21T18:38:40.983ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6302025-03-21T18:38:40.983ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/debug"), full_name: "oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/debug" } file = sled-storage/src/manager.rs:1433
6312025-03-21T18:38:41.016ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6322025-03-21T18:38:41.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6332025-03-21T18:38:41.021ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6342025-03-21T18:38:41.021ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b" } file = sled-storage/src/manager.rs:1433
6352025-03-21T18:38:41.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6362025-03-21T18:38:41.098ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6372025-03-21T18:38:41.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crucible" } file = sled-storage/src/manager.rs:1433
6382025-03-21T18:38:41.165ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6392025-03-21T18:38:41.165ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6402025-03-21T18:38:41.165ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119"), full_name: "oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crypt/zone/oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119" } file = sled-storage/src/manager.rs:1433
6412025-03-21T18:38:41.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6422025-03-21T18:38:41.239ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6432025-03-21T18:38:41.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29"), full_name: "oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/zone/oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29" } file = sled-storage/src/manager.rs:1433
6442025-03-21T18:38:41.315ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6452025-03-21T18:38:41.315ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6462025-03-21T18:38:41.315ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6472025-03-21T18:38:41.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4054029 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36727 req_id = 05d8b7e4-f18a-4167-b9f5-82a24ec087dd response_code = 200 uri = /datasets
6482025-03-21T18:38:41.347ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3baf715a-13aa-42bd-a7aa-c26883abcb17 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
6492025-03-21T18:38:41.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57354
6502025-03-21T18:38:41.347ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6512025-03-21T18:38:41.347ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-03-21T18:38:41.358ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6532025-03-21T18:38:41.358ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542025-03-21T18:38:41.367ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6552025-03-21T18:38:41.367ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6562025-03-21T18:38:41.376ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6572025-03-21T18:38:41.376ZINFOSledAgent (ServiceManager): No ledger in /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:186
6582025-03-21T18:38:41.376ZINFOSledAgent (ServiceManager): No ledger in /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:186
6592025-03-21T18:38:41.376ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6602025-03-21T18:38:41.376ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-03-21T18:38:41.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-03-21T18:38:41.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-03-21T18:38:41.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-03-21T18:38:41.481ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 file = illumos-utils/src/zone.rs:327
6652025-03-21T18:38:41.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 file = illumos-utils/src/zone.rs:327
6662025-03-21T18:38:41.488ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17 file = illumos-utils/src/zone.rs:327
6672025-03-21T18:38:41.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 file = illumos-utils/src/zone.rs:365
6682025-03-21T18:38:41.505ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 file = illumos-utils/src/zone.rs:365
6692025-03-21T18:38:41.509ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17 file = illumos-utils/src/zone.rs:365
6702025-03-21T18:38:42.018ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/probe_manager.rs:234 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6712025-03-21T18:38:42.694ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6176547455713260275 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6722025-03-21T18:38:42.694ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1844007018964060289 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6732025-03-21T18:38:43.152ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4367
6742025-03-21T18:38:43.152ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4377 gateway = fd00:1122:3344:101::1
6752025-03-21T18:38:43.158ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4391 gateway = fd00:1122:3344:101::1
6762025-03-21T18:38:43.158ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4456
6772025-03-21T18:38:43.219ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-03-21T18:38:43.311ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4497
6792025-03-21T18:38:43.311ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4530
6802025-03-21T18:38:43.351ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4543
6812025-03-21T18:38:43.351ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4408
6822025-03-21T18:38:43.401ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4450
6832025-03-21T18:38:43.402ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4507 rack_subnet = fd00:1122:3344::
6842025-03-21T18:38:43.421ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4518
6852025-03-21T18:38:43.421ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4600
6862025-03-21T18:38:43.489ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4632
6872025-03-21T18:38:43.489ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4638
6882025-03-21T18:38:43.575ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4679
6892025-03-21T18:38:43.575ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4549
6902025-03-21T18:38:43.666ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4582
6912025-03-21T18:38:43.666ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6922025-03-21T18:38:43.697ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932025-03-21T18:38:43.697ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
6942025-03-21T18:38:43.708ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/84074e7c-1a32-4c31-a122-c0b819b9b406) file = sled-agent/src/nexus.rs:530 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
6952025-03-21T18:38:43.708ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6962025-03-21T18:38:43.746ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6972025-03-21T18:38:43.746ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6982025-03-21T18:38:43.747ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6992025-03-21T18:38:43.747ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7002025-03-21T18:38:43.786ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
7012025-03-21T18:38:43.839ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7022025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7032025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7042025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7052025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7062025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7072025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7082025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7092025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7102025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7112025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7122025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7132025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7142025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7152025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7162025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7172025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7182025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7192025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7202025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7212025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7222025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7232025-03-21T18:38:43.840ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7242025-03-21T18:38:43.921ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6652026618285314607 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
7252025-03-21T18:38:43.921ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8789954377777244907 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
7262025-03-21T18:38:44.183ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7272025-03-21T18:38:44.183ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7282025-03-21T18:38:44.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 53.218035ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7292025-03-21T18:38:44.200ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7302025-03-21T18:38:44.263ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 123.721997ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7312025-03-21T18:38:44.324ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 32.111216ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7322025-03-21T18:38:44.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 29.093835ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7332025-03-21T18:38:44.364ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 50.628823ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7342025-03-21T18:38:44.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 101.401119ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7352025-03-21T18:38:44.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 243.516706ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7362025-03-21T18:38:44.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 113.010656ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7372025-03-21T18:38:44.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 169.892441ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7382025-03-21T18:38:44.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 389.298455ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7392025-03-21T18:38:44.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 419.643774ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7402025-03-21T18:38:44.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 506.651783ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7412025-03-21T18:38:45.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 994.047018ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7422025-03-21T18:38:45.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 872.927482ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7432025-03-21T18:38:45.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 624.915152ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7442025-03-21T18:38:45.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 1.183965744s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7452025-03-21T18:38:46.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 1.104893675s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7462025-03-21T18:38:46.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 1.390057206s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7472025-03-21T18:38:47.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 1.31632268s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7482025-03-21T18:38:47.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 804.784379ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7492025-03-21T18:38:47.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 507.436419ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7502025-03-21T18:38:48.014ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 713.304225ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7512025-03-21T18:38:48.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 648.030568ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7522025-03-21T18:38:48.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17") failed: Property not found. retry in 1.481061697s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7532025-03-21T18:38:48.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41") failed: Property not found. retry in 750.636674ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7542025-03-21T18:38:48.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2") failed: Property not found. retry in 1.423596533s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7552025-03-21T18:38:50.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2
7562025-03-21T18:38:50.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_a0a4162f-0d7e-4fdd-81dc-3597f7f19d41
7572025-03-21T18:38:50.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_3baf715a-13aa-42bd-a7aa-c26883abcb17
7582025-03-21T18:38:50.178ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7592025-03-21T18:38:50.178ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
7602025-03-21T18:38:50.178ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7612025-03-21T18:38:50.178ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
7622025-03-21T18:38:50.179ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
7632025-03-21T18:38:50.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8831460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57354 req_id = 47ca842b-ebcf-4403-b0ef-6b61c90388be response_code = 204 uri = /omicron-zones
7642025-03-21T18:38:50.181ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7652025-03-21T18:38:50.352ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 55.617056ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:745
7662025-03-21T18:38:50.408ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 174.220831ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:745
7672025-03-21T18:38:50.601ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7682025-03-21T18:38:50.649ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7692025-03-21T18:38:50.697ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:761
7702025-03-21T18:38:50.697ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7712025-03-21T18:38:50.729ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7722025-03-21T18:38:50.730ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7732025-03-21T18:38:50.730ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7742025-03-21T18:38:50.759ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3baf715a-13aa-42bd-a7aa-c26883abcb17 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8f4947d8-e403-45b7-8236-919f6a6e882b, kind: Service { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 }, name: Name("ntp-cd91cf36-5ebe-49e1-8ee9-191291d571e5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
7752025-03-21T18:38:50.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43892
7762025-03-21T18:38:50.759ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7772025-03-21T18:38:50.759ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7782025-03-21T18:38:50.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-03-21T18:38:50.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-03-21T18:38:50.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-03-21T18:38:50.782ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-03-21T18:38:50.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7832025-03-21T18:38:50.791ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
7842025-03-21T18:38:50.792ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
7852025-03-21T18:38:50.792ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7862025-03-21T18:38:50.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-03-21T18:38:50.803ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7882025-03-21T18:38:50.834ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7892025-03-21T18:38:50.835ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7902025-03-21T18:38:50.835ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7912025-03-21T18:38:50.865ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 174, 247]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7922025-03-21T18:38:50.865ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = boundary_ntp
7932025-03-21T18:38:50.865ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7942025-03-21T18:38:50.865ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7952025-03-21T18:38:50.865ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7962025-03-21T18:38:50.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7972025-03-21T18:38:50.888ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5 file = illumos-utils/src/zone.rs:327
7982025-03-21T18:38:50.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5 file = illumos-utils/src/zone.rs:365
7992025-03-21T18:38:51.568ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002025-03-21T18:38:51.568ZINFOSledAgent (ServiceManager): Booting oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8012025-03-21T18:38:51.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 56.151226ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8022025-03-21T18:38:51.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 97.374817ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8032025-03-21T18:38:51.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 130.623326ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8042025-03-21T18:38:52.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 285.558729ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8052025-03-21T18:38:52.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 686.086874ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8062025-03-21T18:38:52.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6176547455713260275 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8072025-03-21T18:38:52.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1844007018964060289 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8082025-03-21T18:38:53.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 889.74787ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8092025-03-21T18:38:53.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 1.42491176s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8102025-03-21T18:38:53.923ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6652026618285314607 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8112025-03-21T18:38:53.923ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8789954377777244907 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8122025-03-21T18:38:55.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 833.106389ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8132025-03-21T18:38:56.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5") failed: Property not found. retry in 1.183875634s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8142025-03-21T18:38:57.392ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5
8152025-03-21T18:38:57.392ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8162025-03-21T18:38:57.393ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8172025-03-21T18:38:57.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6633773 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43892 req_id = 65e48ae4-f8ee-41c1-b3ce-daee821d99b1 response_code = 204 uri = /omicron-zones
8182025-03-21T18:38:57.395ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:802
8192025-03-21T18:38:57.425ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8202025-03-21T18:38:57.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62221
8212025-03-21T18:38:57.434ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8222025-03-21T18:38:57.434ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8497 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62221 req_id = 63f3e37a-8578-4ef9-8856-f77a57f0e4c7 response_code = 500 uri = /timesync
8232025-03-21T18:38:57.436ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8242025-03-21T18:38:57.599ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8252025-03-21T18:38:57.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57443
8262025-03-21T18:38:59.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8218979594791275369 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8272025-03-21T18:38:59.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3322150833104678799 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8282025-03-21T18:39:00.180ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13426037703548737471 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8292025-03-21T18:39:01.607ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8302025-03-21T18:39:01.607ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57443 req_id = 561426e5-4fde-4346-a0c9-93fad590bfcd response_code = 500 uri = /timesync
8312025-03-21T18:39:01.609ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8322025-03-21T18:39:01.752ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8332025-03-21T18:39:01.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64312
8342025-03-21T18:39:01.761ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8352025-03-21T18:39:01.761ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64312 req_id = 87cf82e3-6d5b-4a06-895c-7748478e3cf5 response_code = 500 uri = /timesync
8362025-03-21T18:39:01.764ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8372025-03-21T18:39:01.952ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8382025-03-21T18:39:01.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61215
8392025-03-21T18:39:01.961ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd91cf36-5ebe-49e1-8ee9-191291d571e5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8402025-03-21T18:39:01.961ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61215 req_id = 52227b40-d3dc-4116-b7ef-04faeafe3c9b response_code = 500 uri = /timesync
8412025-03-21T18:39:01.963ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8422025-03-21T18:39:02.100ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8432025-03-21T18:39:02.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45001
8442025-03-21T18:39:02.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45001 req_id = eb9f8ad0-faad-4c60-92f1-64d0867210bc response_code = 200 uri = /timesync
8452025-03-21T18:39:02.110ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8462025-03-21T18:39:02.110ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8472025-03-21T18:39:02.330ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8482025-03-21T18:39:02.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33626
8492025-03-21T18:39:02.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33626 req_id = 7dbcce87-6db1-48ff-96e5-d44491e9b609 response_code = 200 uri = /timesync
8502025-03-21T18:39:02.340ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8512025-03-21T18:39:02.340ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8522025-03-21T18:39:02.517ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8532025-03-21T18:39:02.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47125
8542025-03-21T18:39:02.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47125 req_id = 44094365-83d8-47ed-a903-1d807b947890 response_code = 200 uri = /timesync
8552025-03-21T18:39:02.528ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8562025-03-21T18:39:02.528ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8572025-03-21T18:39:02.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6176547455713260275 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8582025-03-21T18:39:02.699ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1844007018964060289 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8592025-03-21T18:39:02.802ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8602025-03-21T18:39:02.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64760
8612025-03-21T18:39:02.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64760 req_id = fd200e4d-86bc-4bc2-aca9-4e781cf38200 response_code = 200 uri = /timesync
8622025-03-21T18:39:02.812ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8632025-03-21T18:39:02.812ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8642025-03-21T18:39:03.318ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8652025-03-21T18:39:03.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35388
8662025-03-21T18:39:03.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8473 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35388 req_id = 0e332523-61ed-4002-8998-3a019166c70f response_code = 200 uri = /timesync
8672025-03-21T18:39:03.329ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8682025-03-21T18:39:03.329ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8692025-03-21T18:39:03.789ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8702025-03-21T18:39:03.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59855
8712025-03-21T18:39:03.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8922 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59855 req_id = 10e3edf2-4d89-4ade-a76d-a38bbd616d8a response_code = 200 uri = /timesync
8722025-03-21T18:39:03.800ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.05038305 } file = sled-agent/src/rack_setup/service.rs:810
8732025-03-21T18:39:03.800ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8742025-03-21T18:39:03.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6652026618285314607 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8752025-03-21T18:39:03.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8789954377777244907 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
8762025-03-21T18:39:04.431ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8772025-03-21T18:39:04.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40658
8782025-03-21T18:39:04.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40658 req_id = 90d3337d-0d87-4b22-8e97-e1ef33dde906 response_code = 200 uri = /timesync
8792025-03-21T18:39:04.442ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.04865082 } file = sled-agent/src/rack_setup/service.rs:810
8802025-03-21T18:39:04.442ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8812025-03-21T18:39:05.386ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8822025-03-21T18:39:05.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51524
8832025-03-21T18:39:05.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51524 req_id = f1c08e84-3fbf-41ca-bbc4-d38017e42e18 response_code = 200 uri = /timesync
8842025-03-21T18:39:05.396ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.046505008 } file = sled-agent/src/rack_setup/service.rs:810
8852025-03-21T18:39:05.396ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8862025-03-21T18:39:06.476ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8872025-03-21T18:39:06.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61263
8882025-03-21T18:39:06.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61263 req_id = 45129074-6c08-4eac-8f8c-a9343aa21423 response_code = 200 uri = /timesync
8892025-03-21T18:39:06.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3638887493, ip_addr: 216.229.4.69, stratum: 3, ref_time: 1742582345.0710275, correction: 0.041779418 } file = sled-agent/src/rack_setup/service.rs:810
8902025-03-21T18:39:06.502ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1445
8912025-03-21T18:39:06.532ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3baf715a-13aa-42bd-a7aa-c26883abcb17 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8f4947d8-e403-45b7-8236-919f6a6e882b, kind: Service { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 }, name: Name("ntp-cd91cf36-5ebe-49e1-8ee9-191291d571e5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 59da3838-07ba-417c-99b8-e9d415e0ea16 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 07d750a6-7bd6-49e3-b6e6-662ffc4396c9 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b8716ab6-f35d-49a6-9880-04669f488119 (service), filesystem_pool: Some(ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
8922025-03-21T18:39:06.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42107
8932025-03-21T18:39:06.532ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8942025-03-21T18:39:06.532ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8952025-03-21T18:39:06.544ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8962025-03-21T18:39:06.544ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8972025-03-21T18:39:06.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8982025-03-21T18:39:06.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8992025-03-21T18:39:06.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-03-21T18:39:06.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012025-03-21T18:39:06.576ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-03-21T18:39:06.576ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032025-03-21T18:39:06.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-03-21T18:39:06.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052025-03-21T18:39:06.594ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-03-21T18:39:06.594ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072025-03-21T18:39:06.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-03-21T18:39:06.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092025-03-21T18:39:06.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9102025-03-21T18:39:06.614ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
9112025-03-21T18:39:06.614ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
9122025-03-21T18:39:06.614ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9132025-03-21T18:39:06.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9142025-03-21T18:39:06.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9152025-03-21T18:39:06.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9162025-03-21T18:39:06.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172025-03-21T18:39:06.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9182025-03-21T18:39:06.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9192025-03-21T18:39:06.790ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119 file = illumos-utils/src/zone.rs:327
9202025-03-21T18:39:06.795ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16 file = illumos-utils/src/zone.rs:327
9212025-03-21T18:39:06.799ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f file = illumos-utils/src/zone.rs:327
9222025-03-21T18:39:06.803ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9 file = illumos-utils/src/zone.rs:327
9232025-03-21T18:39:06.808ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9 file = illumos-utils/src/zone.rs:327
9242025-03-21T18:39:06.813ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119 file = illumos-utils/src/zone.rs:365
9252025-03-21T18:39:06.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16 file = illumos-utils/src/zone.rs:365
9262025-03-21T18:39:06.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f file = illumos-utils/src/zone.rs:365
9272025-03-21T18:39:06.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9 file = illumos-utils/src/zone.rs:365
9282025-03-21T18:39:06.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9 file = illumos-utils/src/zone.rs:365
9292025-03-21T18:39:09.849ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b8716ab6-f35d-49a6-9880-04669f488119'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9302025-03-21T18:39:09.849ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9312025-03-21T18:39:09.854ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9322025-03-21T18:39:09.855ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9332025-03-21T18:39:09.902ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9342025-03-21T18:39:09.902ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='07d750a6-7bd6-49e3-b6e6-662ffc4396c9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9352025-03-21T18:39:09.902ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9362025-03-21T18:39:09.908ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9372025-03-21T18:39:09.948ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='59da3838-07ba-417c-99b8-e9d415e0ea16'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382025-03-21T18:39:09.948ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9392025-03-21T18:39:09.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 61.456535ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9402025-03-21T18:39:10.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 47.431597ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9412025-03-21T18:39:10.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 42.650479ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9422025-03-21T18:39:10.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 65.231709ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9432025-03-21T18:39:10.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 52.025553ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9442025-03-21T18:39:10.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 54.656429ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9452025-03-21T18:39:10.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 142.637487ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9462025-03-21T18:39:10.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 233.832325ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9472025-03-21T18:39:11.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 90.938948ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9482025-03-21T18:39:11.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 146.966217ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9492025-03-21T18:39:11.176ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 67.195735ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9502025-03-21T18:39:11.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 127.827377ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9512025-03-21T18:39:11.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 316.337504ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9522025-03-21T18:39:11.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 183.807059ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9532025-03-21T18:39:11.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 241.330418ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9542025-03-21T18:39:11.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 121.75104ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9552025-03-21T18:39:11.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 398.831823ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9562025-03-21T18:39:11.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 557.052456ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9572025-03-21T18:39:11.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 232.73655ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9582025-03-21T18:39:11.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.16234162s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9592025-03-21T18:39:11.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 916.12207ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9602025-03-21T18:39:11.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 633.493582ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9612025-03-21T18:39:11.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 339.976819ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9622025-03-21T18:39:12.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 949.131492ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9632025-03-21T18:39:12.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 1.071491549s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9642025-03-21T18:39:12.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 956.874304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9652025-03-21T18:39:12.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 639.756214ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9662025-03-21T18:39:12.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 990.243977ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9672025-03-21T18:39:13.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 765.51003ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9682025-03-21T18:39:13.229ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.079787645s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9692025-03-21T18:39:13.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 1.41113194s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9702025-03-21T18:39:13.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62163
9712025-03-21T18:39:13.397ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62163 req_id = 857196fd-e3dd-49c2-8c27-91a12188a83c response_code = 200 uri = /baseboard
9722025-03-21T18:39:13.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 1.218411816s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9732025-03-21T18:39:13.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.303941274s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9742025-03-21T18:39:13.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.45542279s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9752025-03-21T18:39:14.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.005898552s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9762025-03-21T18:39:14.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 1.223301282s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9772025-03-21T18:39:14.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 1.119861737s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9782025-03-21T18:39:15.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 740.965899ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9792025-03-21T18:39:15.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.248872763s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9802025-03-21T18:39:15.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 936.336594ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9812025-03-21T18:39:15.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 627.46412ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9822025-03-21T18:39:15.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.475003731s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9832025-03-21T18:39:15.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 751.20045ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9842025-03-21T18:39:16.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 677.801717ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9852025-03-21T18:39:16.503ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 1.331190414s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9862025-03-21T18:39:16.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.026537497s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9872025-03-21T18:39:16.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 570.250973ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9882025-03-21T18:39:16.830ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 337.208493ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
9892025-03-21T18:39:16.984ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.194673295s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9902025-03-21T18:39:17.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 890.103885ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9912025-03-21T18:39:17.362ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 913.882952ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9922025-03-21T18:39:17.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.243005563s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9932025-03-21T18:39:17.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16") failed: Property not found. retry in 716.738729ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
9942025-03-21T18:39:18.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f") failed: Property not found. retry in 864.577517ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
9952025-03-21T18:39:18.193ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.338388747s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
9962025-03-21T18:39:18.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 964.254968ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9972025-03-21T18:39:18.896ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.131288152s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
9982025-03-21T18:39:19.266ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.091469297s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
9992025-03-21T18:39:19.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 810.715206ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10002025-03-21T18:39:20.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.035876488s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10012025-03-21T18:39:20.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 957.309109ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10022025-03-21T18:39:20.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 706.856005ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10032025-03-21T18:39:21.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.475225725s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10042025-03-21T18:39:21.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.361586437s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10052025-03-21T18:39:21.531ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
10062025-03-21T18:39:21.546ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
10072025-03-21T18:39:21.547ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
10082025-03-21T18:39:21.547ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
10092025-03-21T18:39:21.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 807.690304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10102025-03-21T18:39:22.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.104521487s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10112025-03-21T18:39:22.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 536.631242ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10122025-03-21T18:39:22.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 733.762887ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10132025-03-21T18:39:23.154ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.266509563s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10142025-03-21T18:39:23.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.452360072s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10152025-03-21T18:39:23.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 967.372309ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10162025-03-21T18:39:24.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 957.491901ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10172025-03-21T18:39:24.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.412054513s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10182025-03-21T18:39:24.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 936.19423ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10192025-03-21T18:39:25.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 721.08315ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10202025-03-21T18:39:25.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 735.922593ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10212025-03-21T18:39:26.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 706.583978ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10222025-03-21T18:39:26.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 1.373266574s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10232025-03-21T18:39:26.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 602.020067ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10242025-03-21T18:39:26.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.290082389s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10252025-03-21T18:39:27.257ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9") failed: Property not found. retry in 1.47890281s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10262025-03-21T18:39:27.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 824.735567ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10272025-03-21T18:39:28.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119") failed: Property not found. retry in 1.137220733s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10282025-03-21T18:39:28.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9") failed: Property not found. retry in 863.906648ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10292025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_b8716ab6-f35d-49a6-9880-04669f488119
10302025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_59da3838-07ba-417c-99b8-e9d415e0ea16
10312025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f
10322025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9
10332025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9
10342025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10352025-03-21T18:39:29.237ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10362025-03-21T18:39:29.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22662961 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42107 req_id = f992aba8-f20f-4b68-b5ae-1fa556299d5e response_code = 204 uri = /omicron-zones
10372025-03-21T18:39:29.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59995
10382025-03-21T18:39:29.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_07d750a6-7bd6-49e3-b6e6-662ffc4396c9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 33688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59995 req_id = 89501e70-8cf6-46a8-ae30-97c43a199ea7 response_code = 500 uri = /cockroachdb
10392025-03-21T18:39:29.310ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "89501e70-8cf6-46a8-ae30-97c43a199ea7", "content-length": "124", "date": "Fri, 21 Mar 2025 18:39:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "89501e70-8cf6-46a8-ae30-97c43a199ea7" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 137.327537ms
10402025-03-21T18:39:29.478ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3818
10412025-03-21T18:39:42.486ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3836
10422025-03-21T18:39:54.600ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3859
10432025-03-21T18:39:54.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25153596 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59995 req_id = 55b0f2cf-e2e7-4038-98bd-bab2abb29b98 response_code = 204 uri = /cockroachdb
10442025-03-21T18:39:54.611ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35104
10452025-03-21T18:39:54.614ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1157 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35104 req_id = 1a57153d-938f-48ec-b430-b484772e2905 response_code = 200 uri = /baseboard
10462025-03-21T18:39:54.630ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 387.872892ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
10472025-03-21T18:39:54.670ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: a0a4162f-0d7e-4fdd-81dc-3597f7f19d41 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd1a4c46-6edf-4cec-b78e-f7712fa5c1f2 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3baf715a-13aa-42bd-a7aa-c26883abcb17 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8f4947d8-e403-45b7-8236-919f6a6e882b, kind: Service { id: cd91cf36-5ebe-49e1-8ee9-191291d571e5 }, name: Name("ntp-cd91cf36-5ebe-49e1-8ee9-191291d571e5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 5ce4a289-f9a5-4e4e-86d3-f13c2dd7d85f (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 59da3838-07ba-417c-99b8-e9d415e0ea16 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3dc7bdbf-0e56-4805-b335-d05d2e9a1ea9 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 07d750a6-7bd6-49e3-b6e6-662ffc4396c9 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b8716ab6-f35d-49a6-9880-04669f488119 (service), filesystem_pool: Some(ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 5d94b88f-d605-40ae-bdec-b8303d159330 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 143937aa-1662-4be7-b315-db1f929987b0 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf (service), filesystem_pool: Some(ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 02fc0a56-1448-4d70-95c0-f34330562c4b (service), filesystem_pool: Some(ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: c9313efa-637b-46a6-8199-b515674fa14e (service), filesystem_pool: Some(ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 0e3eb50f-78e6-4909-9a08-8c652e364f76 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1f205a99-fd9d-4d22-94be-e3b9dc968775 (service), filesystem_pool: Some(ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 5a548b54-4b29-4bcd-a95c-aacf544dec91 (service), filesystem_pool: Some(ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 451fee58-0223-4990-affa-f574ce1ea6b3 (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6a3afce7-5bd8-41a1-9d14-68b9db589357 (service), filesystem_pool: Some(ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3dfe96d0-d03b-4607-9cfe-63610e8dd6f8 (service), filesystem_pool: Some(ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 630a8647-9e76-4241-8d2b-4ada315fec5b (service), filesystem_pool: Some(ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 85a80821-afbd-49ef-b77b-803d4b5fb1e0 (service), filesystem_pool: Some(ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3dd7c84f-f9bd-4152-b3bf-dd0998c69786 (service), filesystem_pool: Some(ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e7c0f996-ed3a-4dd0-a532-6e3c8a71193e (service), filesystem_pool: Some(ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: bb97e273-601a-4b5b-8732-e5ed62596034 (service), filesystem_pool: Some(ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7d216c11-4f13-431f-ab10-e98977a8f493 (service), filesystem_pool: Some(ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 96e4164c-0738-4ba7-90a0-766f377a7c30 (service), filesystem_pool: Some(ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
10482025-03-21T18:39:54.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44993
10492025-03-21T18:39:54.674ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-03-21T18:39:54.674ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10512025-03-21T18:39:54.690ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-03-21T18:39:54.690ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10532025-03-21T18:39:54.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-03-21T18:39:54.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10552025-03-21T18:39:54.711ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-03-21T18:39:54.711ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10572025-03-21T18:39:54.720ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-03-21T18:39:54.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10592025-03-21T18:39:54.731ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-03-21T18:39:54.731ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10612025-03-21T18:39:54.741ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10622025-03-21T18:39:54.741ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Cockroach }, responder: ... }
10632025-03-21T18:39:54.750ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10642025-03-21T18:39:54.750ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10652025-03-21T18:39:54.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10662025-03-21T18:39:54.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10672025-03-21T18:39:54.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10682025-03-21T18:39:54.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10692025-03-21T18:39:54.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10702025-03-21T18:39:54.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10712025-03-21T18:39:54.794ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10722025-03-21T18:39:54.794ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, kind: Crucible }, responder: ... }
10732025-03-21T18:39:54.804ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10742025-03-21T18:39:54.804ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, kind: Crucible }, responder: ... }
10752025-03-21T18:39:54.814ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10762025-03-21T18:39:54.814ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10772025-03-21T18:39:54.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10782025-03-21T18:39:54.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, kind: Crucible }, responder: ... }
10792025-03-21T18:39:54.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10802025-03-21T18:39:54.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, kind: Crucible }, responder: ... }
10812025-03-21T18:39:54.845ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10822025-03-21T18:39:54.845ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, kind: Crucible }, responder: ... }
10832025-03-21T18:39:54.857ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10842025-03-21T18:39:54.857ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, kind: Crucible }, responder: ... }
10852025-03-21T18:39:54.867ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10862025-03-21T18:39:54.867ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, kind: Crucible }, responder: ... }
10872025-03-21T18:39:54.878ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10882025-03-21T18:39:54.878ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, kind: Crucible }, responder: ... }
10892025-03-21T18:39:54.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902025-03-21T18:39:54.889ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
10912025-03-21T18:39:54.889ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
10922025-03-21T18:39:54.890ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
10932025-03-21T18:39:54.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942025-03-21T18:39:55.019ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10952025-03-21T18:39:55.050ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10962025-03-21T18:39:55.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-03-21T18:39:55.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-03-21T18:39:55.064ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10992025-03-21T18:39:55.065ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-03-21T18:39:55.068ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11012025-03-21T18:39:55.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-03-21T18:39:55.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11032025-03-21T18:39:55.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11042025-03-21T18:39:55.276ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11052025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11062025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11072025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11082025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11102025-03-21T18:39:55.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11112025-03-21T18:39:55.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11122025-03-21T18:39:55.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-03-21T18:39:55.288ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357 file = illumos-utils/src/zone.rs:327
11142025-03-21T18:39:55.293ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493 file = illumos-utils/src/zone.rs:327
11152025-03-21T18:39:55.298ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3 file = illumos-utils/src/zone.rs:327
11162025-03-21T18:39:55.303ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775 file = illumos-utils/src/zone.rs:327
11172025-03-21T18:39:55.309ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8 file = illumos-utils/src/zone.rs:327
11182025-03-21T18:39:55.314ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91 file = illumos-utils/src/zone.rs:327
11192025-03-21T18:39:55.473ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357 file = illumos-utils/src/zone.rs:365
11202025-03-21T18:39:55.479ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493 file = illumos-utils/src/zone.rs:365
11212025-03-21T18:39:55.485ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3 file = illumos-utils/src/zone.rs:365
11222025-03-21T18:39:55.490ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775 file = illumos-utils/src/zone.rs:365
11232025-03-21T18:39:55.495ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8 file = illumos-utils/src/zone.rs:365
11242025-03-21T18:39:55.500ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91 file = illumos-utils/src/zone.rs:365
11252025-03-21T18:39:55.505ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76 file = illumos-utils/src/zone.rs:327
11262025-03-21T18:39:55.510ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034 file = illumos-utils/src/zone.rs:327
11272025-03-21T18:39:55.516ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0 file = illumos-utils/src/zone.rs:327
11282025-03-21T18:39:55.521ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e file = illumos-utils/src/zone.rs:327
11292025-03-21T18:39:55.528ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b file = illumos-utils/src/zone.rs:327
11302025-03-21T18:39:55.534ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e file = illumos-utils/src/zone.rs:327
11312025-03-21T18:39:55.541ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30 file = illumos-utils/src/zone.rs:327
11322025-03-21T18:39:55.549ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786 file = illumos-utils/src/zone.rs:327
11332025-03-21T18:39:55.612ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11342025-03-21T18:39:55.664ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11352025-03-21T18:39:55.664ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76 file = illumos-utils/src/zone.rs:365
11362025-03-21T18:39:55.672ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034 file = illumos-utils/src/zone.rs:365
11372025-03-21T18:39:55.681ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0 file = illumos-utils/src/zone.rs:365
11382025-03-21T18:39:55.690ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e file = illumos-utils/src/zone.rs:365
11392025-03-21T18:39:55.698ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b file = illumos-utils/src/zone.rs:365
11402025-03-21T18:39:55.705ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e file = illumos-utils/src/zone.rs:365
11412025-03-21T18:39:55.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30 file = illumos-utils/src/zone.rs:365
11422025-03-21T18:39:55.721ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786 file = illumos-utils/src/zone.rs:365
11432025-03-21T18:39:55.785ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11442025-03-21T18:39:55.842ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11452025-03-21T18:39:55.907ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11462025-03-21T18:39:55.912ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11472025-03-21T18:39:55.915ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11482025-03-21T18:39:55.984ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 141, 73]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11492025-03-21T18:39:55.984ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11502025-03-21T18:39:55.987ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11512025-03-21T18:39:55.987ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11522025-03-21T18:39:56.045ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 133, 154]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11532025-03-21T18:39:56.045ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11542025-03-21T18:39:56.046ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11552025-03-21T18:39:56.046ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11562025-03-21T18:39:56.111ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 235, 162]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11572025-03-21T18:39:56.111ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11582025-03-21T18:39:56.114ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11592025-03-21T18:39:56.114ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11602025-03-21T18:39:56.175ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 234, 65]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11612025-03-21T18:39:56.175ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11622025-03-21T18:39:56.179ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11632025-03-21T18:39:56.179ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11642025-03-21T18:39:56.259ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 144, 50]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11652025-03-21T18:39:56.259ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11662025-03-21T18:39:56.261ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11672025-03-21T18:39:56.261ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11682025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11692025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11702025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11712025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11722025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11732025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11742025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11752025-03-21T18:39:56.262ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11762025-03-21T18:39:56.273ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11772025-03-21T18:39:56.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11782025-03-21T18:39:56.350ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11792025-03-21T18:39:56.353ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11802025-03-21T18:39:56.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11812025-03-21T18:39:56.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11822025-03-21T18:39:56.357ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11832025-03-21T18:39:56.361ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11842025-03-21T18:39:56.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11852025-03-21T18:39:56.518ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11862025-03-21T18:39:56.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330 file = illumos-utils/src/zone.rs:327
11872025-03-21T18:39:56.646ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b file = illumos-utils/src/zone.rs:327
11882025-03-21T18:39:56.665ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29 file = illumos-utils/src/zone.rs:327
11892025-03-21T18:39:56.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0 file = illumos-utils/src/zone.rs:327
11902025-03-21T18:39:56.699ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf file = illumos-utils/src/zone.rs:327
11912025-03-21T18:39:56.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330 file = illumos-utils/src/zone.rs:365
11922025-03-21T18:39:56.719ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b file = illumos-utils/src/zone.rs:365
11932025-03-21T18:39:56.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29 file = illumos-utils/src/zone.rs:365
11942025-03-21T18:39:56.746ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0 file = illumos-utils/src/zone.rs:365
11952025-03-21T18:39:56.758ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf file = illumos-utils/src/zone.rs:365
11962025-03-21T18:39:59.036ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972025-03-21T18:39:59.036ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-03-21T18:39:59.061ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
11992025-03-21T18:39:59.074ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12002025-03-21T18:39:59.963ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_93f27406-584f-49b0-bbdf-aec064c7573f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='72de0588-e612-49e4-991c-bf3d66a39e9e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12012025-03-21T18:40:00.035ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5415cb55-face-45fd-a0d4-837887c96243'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-03-21T18:40:00.035ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_746ded48-1093-4fb4-a064-8507518ef38c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9f18b61f-8c3d-42f8-8f10-55e111fbabee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12032025-03-21T18:40:00.036ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1e6727e3-4e26-4e18-8f8f-82d086265583'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042025-03-21T18:40:00.036ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2219f396-1299-4176-91e7-626a9f13bedc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c819f8cf-0332-42a8-b1f9-5a17f2a485eb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052025-03-21T18:40:00.040ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_71dc428d-9d1f-483c-b923-af3efe9583af/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4c7ed602-c5e0-4abc-9e7c-6399cf6de57a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062025-03-21T18:40:00.040ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12072025-03-21T18:40:00.049ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12082025-03-21T18:40:00.057ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12092025-03-21T18:40:00.064ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12102025-03-21T18:40:00.072ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12112025-03-21T18:40:00.079ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12122025-03-21T18:40:00.267ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132025-03-21T18:40:00.267ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12142025-03-21T18:40:01.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 29.38696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12152025-03-21T18:40:01.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 45.895044ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12162025-03-21T18:40:01.385ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 55.934119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12172025-03-21T18:40:01.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 48.110537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12182025-03-21T18:40:01.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 56.824488ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12192025-03-21T18:40:01.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 45.108892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12202025-03-21T18:40:01.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 59.452754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12212025-03-21T18:40:01.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 27.707883ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12222025-03-21T18:40:01.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 55.373354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12232025-03-21T18:40:01.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 68.765158ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12242025-03-21T18:40:01.463ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 67.983791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12252025-03-21T18:40:01.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 125.624129ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12262025-03-21T18:40:01.485ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 113.789836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12272025-03-21T18:40:01.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 103.924635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12282025-03-21T18:40:01.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 50.229668ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12292025-03-21T18:40:01.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 126.473105ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12302025-03-21T18:40:01.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 91.72836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12312025-03-21T18:40:01.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 67.968057ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12322025-03-21T18:40:01.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 166.536706ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12332025-03-21T18:40:01.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 241.417223ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12342025-03-21T18:40:01.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 255.841722ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12352025-03-21T18:40:01.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 283.06106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12362025-03-21T18:40:01.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 122.433401ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12372025-03-21T18:40:01.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 150.104311ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12382025-03-21T18:40:01.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 184.366037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12392025-03-21T18:40:01.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 221.760735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12402025-03-21T18:40:01.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 128.635058ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12412025-03-21T18:40:01.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 418.941921ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12422025-03-21T18:40:01.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 518.229125ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12432025-03-21T18:40:01.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 248.754229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12442025-03-21T18:40:01.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 386.271493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12452025-03-21T18:40:01.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 216.856252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12462025-03-21T18:40:01.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 227.865774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12472025-03-21T18:40:02.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 544.779945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12482025-03-21T18:40:02.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 501.627514ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12492025-03-21T18:40:02.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 492.0465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12502025-03-21T18:40:02.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.064642796s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12512025-03-21T18:40:02.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 803.20556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12522025-03-21T18:40:02.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 461.536972ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12532025-03-21T18:40:02.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 870.610267ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12542025-03-21T18:40:02.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 884.336774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12552025-03-21T18:40:02.394ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7cf38aa8-d03b-4646-adf9-09f10a14b08c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562025-03-21T18:40:02.394ZINFOSledAgent (ServiceManager): Booting oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12572025-03-21T18:40:02.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 969.310168ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12582025-03-21T18:40:02.459ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_47056192-ed60-41f0-aecf-23ae41e9cb50/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='92902463-3a33-4add-ac6a-d992475ad820'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12592025-03-21T18:40:02.459ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12602025-03-21T18:40:02.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 843.086671ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12612025-03-21T18:40:02.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 855.39931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12622025-03-21T18:40:02.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.093161038s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12632025-03-21T18:40:02.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 589.227717ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12642025-03-21T18:40:02.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 67.923598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12652025-03-21T18:40:02.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 30.090522ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12662025-03-21T18:40:02.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 104.540872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12672025-03-21T18:40:02.818ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 105.114635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12682025-03-21T18:40:02.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 225.814148ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12692025-03-21T18:40:02.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 219.564484ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12702025-03-21T18:40:03.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 786.034536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12712025-03-21T18:40:03.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 347.522165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12722025-03-21T18:40:03.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.00085435s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12732025-03-21T18:40:03.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 347.372926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12742025-03-21T18:40:03.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.050629767s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12752025-03-21T18:40:03.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 928.437184ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12762025-03-21T18:40:03.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 532.412117ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12772025-03-21T18:40:03.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 761.816661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12782025-03-21T18:40:03.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.331718556s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
12792025-03-21T18:40:03.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.190025271s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
12802025-03-21T18:40:03.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.182630053s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
12812025-03-21T18:40:03.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.037329544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
12822025-03-21T18:40:03.876ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832025-03-21T18:40:03.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 536.713843ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
12842025-03-21T18:40:03.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 581.951739ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
12852025-03-21T18:40:03.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.18987208s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
12862025-03-21T18:40:03.910ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
12872025-03-21T18:40:03.926ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b0b998ef-e5fe-498b-80aa-251baad58517'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12882025-03-21T18:40:03.926ZINFOSledAgent (ServiceManager): Booting oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
12892025-03-21T18:40:04.151ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 32.191699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
12902025-03-21T18:40:04.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.287184337s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
12912025-03-21T18:40:04.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 681.781284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
12922025-03-21T18:40:04.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 63.40569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
12932025-03-21T18:40:04.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 58.768915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
12942025-03-21T18:40:04.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.299194216s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
12952025-03-21T18:40:04.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 276.277477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
12962025-03-21T18:40:04.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 63.464468ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
12972025-03-21T18:40:04.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.238056749s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
12982025-03-21T18:40:04.343ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12992025-03-21T18:40:04.344ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13002025-03-21T18:40:04.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 106.87167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13012025-03-21T18:40:04.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 597.034974ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13022025-03-21T18:40:04.488ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 324.844897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13032025-03-21T18:40:04.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 529.01741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
13042025-03-21T18:40:04.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 387.88588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13052025-03-21T18:40:04.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 976.590026ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13062025-03-21T18:40:04.993ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 936.722936ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13072025-03-21T18:40:05.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 677.61077ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13082025-03-21T18:40:05.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 43.025446ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13092025-03-21T18:40:05.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.479948695s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
13102025-03-21T18:40:05.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.415769894s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
13112025-03-21T18:40:05.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 519.557386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13122025-03-21T18:40:05.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 772.515537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13132025-03-21T18:40:06.044ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.488208861s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
13142025-03-21T18:40:06.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.41094772s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
13152025-03-21T18:40:06.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.11911804s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
13162025-03-21T18:40:06.158ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.143725127s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13172025-03-21T18:40:06.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.402318911s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
13182025-03-21T18:40:06.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 927.381586ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
13192025-03-21T18:40:06.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.245163689s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13202025-03-21T18:40:06.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.030660432s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13212025-03-21T18:40:06.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.441515793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13222025-03-21T18:40:06.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 104.43082ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13232025-03-21T18:40:06.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 715.656296ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13242025-03-21T18:40:06.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 168.427588ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13252025-03-21T18:40:06.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 588.954709ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13262025-03-21T18:40:06.779ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 675.73053ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13272025-03-21T18:40:07.161ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.307978486s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
13282025-03-21T18:40:07.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.224153365s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
13292025-03-21T18:40:07.290ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 727.157834ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13302025-03-21T18:40:07.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 504.947381ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13312025-03-21T18:40:07.316ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='c9313efa-637b-46a6-8199-b515674fa14e'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322025-03-21T18:40:07.317ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13332025-03-21T18:40:07.365ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 962.293499ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
13342025-03-21T18:40:07.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 904.751492ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13352025-03-21T18:40:07.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 878.047712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13362025-03-21T18:40:07.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.122676008s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
13372025-03-21T18:40:07.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.182107383s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13382025-03-21T18:40:07.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 947.82411ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
13392025-03-21T18:40:07.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.489179464s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13402025-03-21T18:40:07.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.310839312s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
13412025-03-21T18:40:07.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 46.301118ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13422025-03-21T18:40:07.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 901.188031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
13432025-03-21T18:40:07.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 107.661392ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13442025-03-21T18:40:07.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 176.23294ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13452025-03-21T18:40:07.830ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.139868616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13462025-03-21T18:40:07.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 654.396912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13472025-03-21T18:40:07.943ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 277.768047ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13482025-03-21T18:40:08.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 793.898719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13492025-03-21T18:40:08.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 889.777994ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13502025-03-21T18:40:08.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.356025588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13512025-03-21T18:40:08.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 800.827846ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13522025-03-21T18:40:08.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.462436279s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
13532025-03-21T18:40:08.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.076266152s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
13542025-03-21T18:40:08.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 933.67532ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
13552025-03-21T18:40:08.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.155075142s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
13562025-03-21T18:40:08.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.183660032s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
13572025-03-21T18:40:08.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.193233607s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13582025-03-21T18:40:08.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 808.222269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
13592025-03-21T18:40:08.654ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13602025-03-21T18:40:08.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.23141944s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13612025-03-21T18:40:08.665ZINFOSledAgent (ServiceManager): Booting oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13622025-03-21T18:40:08.815ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 51.154705ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13632025-03-21T18:40:08.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.253502627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13642025-03-21T18:40:08.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.270580856s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
13652025-03-21T18:40:08.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 138.557019ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13662025-03-21T18:40:08.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 596.227551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13672025-03-21T18:40:09.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 912.406774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13682025-03-21T18:40:09.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 143.104976ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13692025-03-21T18:40:09.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 928.328234ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13702025-03-21T18:40:09.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.22296082s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13712025-03-21T18:40:09.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 460.001989ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13722025-03-21T18:40:09.381ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 752.444889ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
13732025-03-21T18:40:09.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 796.0609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
13742025-03-21T18:40:09.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 966.591582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
13752025-03-21T18:40:09.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 701.062452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13762025-03-21T18:40:09.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 884.124727ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
13772025-03-21T18:40:09.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.106668442s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13782025-03-21T18:40:09.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.136124579s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13792025-03-21T18:40:09.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.136875114s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
13802025-03-21T18:40:09.736ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.168907056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
13812025-03-21T18:40:09.815ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 960.382524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
13822025-03-21T18:40:09.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.316572067s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
13832025-03-21T18:40:09.931ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 594.586706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13842025-03-21T18:40:10.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 893.850599ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
13852025-03-21T18:40:10.104ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.145141589s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
13862025-03-21T18:40:10.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.296260447s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
13872025-03-21T18:40:10.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.356471878s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
13882025-03-21T18:40:10.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 666.62225ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
13892025-03-21T18:40:10.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.020079445s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
13902025-03-21T18:40:10.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.296873875s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
13912025-03-21T18:40:10.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.106167377s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
13922025-03-21T18:40:10.519ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.229849025s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
13932025-03-21T18:40:10.540ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.294242517s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
13942025-03-21T18:40:10.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 563.344423ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
13952025-03-21T18:40:10.790ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.071591093s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
13962025-03-21T18:40:10.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 528.351282ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
13972025-03-21T18:40:10.847ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.279448875s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
13982025-03-21T18:40:10.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 901.980336ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
13992025-03-21T18:40:10.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.075379925s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14002025-03-21T18:40:10.883ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012025-03-21T18:40:10.883ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14022025-03-21T18:40:10.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.225910874s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14032025-03-21T18:40:10.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.387558306s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
14042025-03-21T18:40:11.070ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052025-03-21T18:40:11.070ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14062025-03-21T18:40:11.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.181686122s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
14072025-03-21T18:40:11.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 44.357402ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14082025-03-21T18:40:11.205ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 141.302085ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14092025-03-21T18:40:11.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 559.202916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14102025-03-21T18:40:11.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.420531268s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
14112025-03-21T18:40:11.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 34.368728ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14122025-03-21T18:40:11.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.219384902s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
14132025-03-21T18:40:11.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 255.321667ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14142025-03-21T18:40:11.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 55.577527ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14152025-03-21T18:40:11.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 732.919658ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
14162025-03-21T18:40:11.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 201.501767ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14172025-03-21T18:40:11.488ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 977.699648ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
14182025-03-21T18:40:11.528ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 537.481536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
14192025-03-21T18:40:11.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 565.503863ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
14202025-03-21T18:40:11.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 317.212281ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14212025-03-21T18:40:11.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 304.844305ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14222025-03-21T18:40:11.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 630.218821ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
14232025-03-21T18:40:11.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 885.540735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14242025-03-21T18:40:11.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 670.125804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14252025-03-21T18:40:11.846ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.035624408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
14262025-03-21T18:40:11.873ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.30199412s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
14272025-03-21T18:40:11.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 915.883479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14282025-03-21T18:40:11.984ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 883.96917ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14292025-03-21T18:40:12.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 904.62822ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14302025-03-21T18:40:12.079ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.4676862s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
14312025-03-21T18:40:12.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.088553695s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
14322025-03-21T18:40:12.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 503.901011ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14332025-03-21T18:40:12.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.36083797s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
14342025-03-21T18:40:12.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.156925405s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
14352025-03-21T18:40:12.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.226219769s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
14362025-03-21T18:40:12.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 795.345187ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
14372025-03-21T18:40:12.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.244840665s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
14382025-03-21T18:40:12.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.04649776s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
14392025-03-21T18:40:12.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.166390835s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14402025-03-21T18:40:12.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.383483897s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
14412025-03-21T18:40:12.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 903.287906ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14422025-03-21T18:40:12.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 819.317666ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14432025-03-21T18:40:12.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 989.70106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
14442025-03-21T18:40:12.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.478481666s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14452025-03-21T18:40:12.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.172941983s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
14462025-03-21T18:40:12.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 843.153295ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14472025-03-21T18:40:12.922ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.016067824s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14482025-03-21T18:40:13.168ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.088855215s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
14492025-03-21T18:40:13.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.255013756s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
14502025-03-21T18:40:13.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 963.27186ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
14512025-03-21T18:40:13.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 512.419771ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
14522025-03-21T18:40:13.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 866.669719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14532025-03-21T18:40:13.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.366924436s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
14542025-03-21T18:40:13.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 531.153555ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
14552025-03-21T18:40:13.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.344274623s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
14562025-03-21T18:40:13.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.221754463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
14572025-03-21T18:40:13.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.079767039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14582025-03-21T18:40:13.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.165974442s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
14592025-03-21T18:40:13.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.344323305s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14602025-03-21T18:40:13.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 526.215845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
14612025-03-21T18:40:13.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.310931327s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14622025-03-21T18:40:13.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.073436489s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
14632025-03-21T18:40:13.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.440142354s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14642025-03-21T18:40:13.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.232781926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
14652025-03-21T18:40:14.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 501.510411ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
14662025-03-21T18:40:14.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.456044709s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
14672025-03-21T18:40:14.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 630.465081ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
14682025-03-21T18:40:14.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.130375803s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
14692025-03-21T18:40:14.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 995.590285ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
14702025-03-21T18:40:14.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.432209019s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14712025-03-21T18:40:14.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 548.819043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14722025-03-21T18:40:14.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 746.828153ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
14732025-03-21T18:40:14.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.267787729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
14742025-03-21T18:40:14.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.216160742s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14752025-03-21T18:40:14.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 501.329841ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
14762025-03-21T18:40:14.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 768.829154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
14772025-03-21T18:40:14.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.496560388s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
14782025-03-21T18:40:14.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.149006584s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
14792025-03-21T18:40:14.922ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.443063627s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
14802025-03-21T18:40:14.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 636.523412ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14812025-03-21T18:40:14.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.466117425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
14822025-03-21T18:40:15.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 622.982935ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14832025-03-21T18:40:15.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 682.923537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14842025-03-21T18:40:15.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.116079648s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
14852025-03-21T18:40:15.235ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.378623785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
14862025-03-21T18:40:15.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.03863737s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
14872025-03-21T18:40:15.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.395407542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
14882025-03-21T18:40:15.376ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.039628167s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
14892025-03-21T18:40:15.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 700.787744ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
14902025-03-21T18:40:15.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 764.127945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
14912025-03-21T18:40:15.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 546.682322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
14922025-03-21T18:40:15.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.042573453s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
14932025-03-21T18:40:15.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 583.429894ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
14942025-03-21T18:40:15.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.224722267s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
14952025-03-21T18:40:15.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.227844126s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
14962025-03-21T18:40:15.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.100728363s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
14972025-03-21T18:40:15.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 632.796679ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
14982025-03-21T18:40:16.071ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.138062459s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
14992025-03-21T18:40:16.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 749.73335ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15002025-03-21T18:40:16.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 921.472185ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
15012025-03-21T18:40:16.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 885.247889ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
15022025-03-21T18:40:16.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.247695743s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
15032025-03-21T18:40:16.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.199228723s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
15042025-03-21T18:40:16.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 555.11741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
15052025-03-21T18:40:16.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 558.059209ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15062025-03-21T18:40:16.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 659.637982ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
15072025-03-21T18:40:16.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 821.229893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15082025-03-21T18:40:16.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 571.203054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15092025-03-21T18:40:16.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 995.827285ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
15102025-03-21T18:40:16.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.035949144s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
15112025-03-21T18:40:16.712ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 685.379228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
15122025-03-21T18:40:16.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 756.433271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
15132025-03-21T18:40:16.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 997.26099ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15142025-03-21T18:40:16.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 731.875991ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
15152025-03-21T18:40:16.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 542.766141ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15162025-03-21T18:40:16.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.468917246s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
15172025-03-21T18:40:16.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.298736251s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
15182025-03-21T18:40:17.039ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 689.508273ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15192025-03-21T18:40:17.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.10714943s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
15202025-03-21T18:40:17.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.267235204s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
15212025-03-21T18:40:17.086ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 560.831388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
15222025-03-21T18:40:17.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 972.704437ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
15232025-03-21T18:40:17.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.257107211s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
15242025-03-21T18:40:17.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 930.876322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15252025-03-21T18:40:17.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.199628268s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
15262025-03-21T18:40:17.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 583.724753ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15272025-03-21T18:40:17.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.049482154s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
15282025-03-21T18:40:17.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.106800448s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
15292025-03-21T18:40:17.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.389516932s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
15302025-03-21T18:40:17.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.473266309s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
15312025-03-21T18:40:17.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.464589753s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
15322025-03-21T18:40:17.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.020006849s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
15332025-03-21T18:40:17.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 826.047441ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
15342025-03-21T18:40:17.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 786.526182ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15352025-03-21T18:40:17.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 649.253607ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15362025-03-21T18:40:17.933ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15372025-03-21T18:40:17.933ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15382025-03-21T18:40:18.067ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 799.1518ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15392025-03-21T18:40:18.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 68.977561ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15402025-03-21T18:40:18.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.47574946s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
15412025-03-21T18:40:18.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 553.678722ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
15422025-03-21T18:40:18.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 580.390325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15432025-03-21T18:40:18.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 78.811715ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15442025-03-21T18:40:18.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 122.378348ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15452025-03-21T18:40:18.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 643.709221ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
15462025-03-21T18:40:18.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 806.988939ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
15472025-03-21T18:40:18.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 417.559416ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15482025-03-21T18:40:18.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.26429092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
15492025-03-21T18:40:18.485ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 576.596566ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
15502025-03-21T18:40:18.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.453463926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
15512025-03-21T18:40:18.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 912.478006ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15522025-03-21T18:40:18.544ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 560.599807ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15532025-03-21T18:40:18.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.015738825s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
15542025-03-21T18:40:18.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 683.118332ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
15552025-03-21T18:40:18.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.121021469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
15562025-03-21T18:40:18.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.46584603s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
15572025-03-21T18:40:18.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.340691344s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
15582025-03-21T18:40:18.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.413063576s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15592025-03-21T18:40:18.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 441.576872ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15602025-03-21T18:40:18.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 949.577419ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15612025-03-21T18:40:18.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.158850171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
15622025-03-21T18:40:18.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.341554591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
15632025-03-21T18:40:19.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 712.357923ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
15642025-03-21T18:40:19.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 850.813303ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
15652025-03-21T18:40:19.115ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 842.456769ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15662025-03-21T18:40:19.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.175427485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
15672025-03-21T18:40:19.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.284868721s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
15682025-03-21T18:40:19.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 972.228182ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15692025-03-21T18:40:19.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.282871911s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
15702025-03-21T18:40:19.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 959.706414ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15712025-03-21T18:40:19.609ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.086669549s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
15722025-03-21T18:40:19.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.303735377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
15732025-03-21T18:40:19.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.130182048s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
15742025-03-21T18:40:19.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.234932313s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
15752025-03-21T18:40:19.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.290149887s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
15762025-03-21T18:40:19.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 594.954318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15772025-03-21T18:40:19.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 707.40883ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
15782025-03-21T18:40:19.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 925.595216ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15792025-03-21T18:40:19.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 936.996393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
15802025-03-21T18:40:20.079ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.382919925s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
15812025-03-21T18:40:20.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 795.624292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
15822025-03-21T18:40:20.168ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 988.339729ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
15832025-03-21T18:40:20.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 575.818979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15842025-03-21T18:40:20.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 1.275080531s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
15852025-03-21T18:40:20.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.475427667s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
15862025-03-21T18:40:20.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.338114063s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
15872025-03-21T18:40:20.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.007528978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
15882025-03-21T18:40:20.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 559.75255ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
15892025-03-21T18:40:20.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.331954408s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
15902025-03-21T18:40:20.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 534.591495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
15912025-03-21T18:40:20.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 888.893942ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
15922025-03-21T18:40:20.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 656.634701ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
15932025-03-21T18:40:20.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 556.7407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
15942025-03-21T18:40:20.872ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.417338282s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
15952025-03-21T18:40:20.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 593.237129ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
15962025-03-21T18:40:20.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.494586023s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
15972025-03-21T18:40:20.939ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.11360555s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
15982025-03-21T18:40:20.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 664.921016ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
15992025-03-21T18:40:21.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.444550508s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16002025-03-21T18:40:21.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 674.416556ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16012025-03-21T18:40:21.102ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.442741978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
16022025-03-21T18:40:21.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.041533911s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16032025-03-21T18:40:21.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 759.109351ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
16042025-03-21T18:40:21.293ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
16052025-03-21T18:40:21.354ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
16062025-03-21T18:40:21.354ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
16072025-03-21T18:40:21.355ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
16082025-03-21T18:40:21.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 763.028566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
16092025-03-21T18:40:21.381ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.326380589s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16102025-03-21T18:40:21.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 989.116722ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
16112025-03-21T18:40:21.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.254125855s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16122025-03-21T18:40:21.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.432343437s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
16132025-03-21T18:40:21.566ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 633.686867ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
16142025-03-21T18:40:21.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 827.431834ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16152025-03-21T18:40:21.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.245235458s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
16162025-03-21T18:40:21.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.13653677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
16172025-03-21T18:40:21.723ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 677.351708ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16182025-03-21T18:40:21.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.479566491s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
16192025-03-21T18:40:21.811ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 767.960932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
16202025-03-21T18:40:21.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 938.221404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
16212025-03-21T18:40:22.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 615.804072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
16222025-03-21T18:40:22.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.056885943s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
16232025-03-21T18:40:22.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.369486235s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
16242025-03-21T18:40:22.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 564.718812ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16252025-03-21T18:40:22.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.313162755s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
16262025-03-21T18:40:22.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 678.518996ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16272025-03-21T18:40:22.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 575.477137ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16282025-03-21T18:40:22.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.380397927s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
16292025-03-21T18:40:22.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.255478983s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
16302025-03-21T18:40:22.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 525.560986ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16312025-03-21T18:40:22.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.427362978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
16322025-03-21T18:40:22.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.193783014s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
16332025-03-21T18:40:22.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 575.580321ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
16342025-03-21T18:40:22.720ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.452112591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16352025-03-21T18:40:22.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 610.256595ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16362025-03-21T18:40:22.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.036684261s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16372025-03-21T18:40:22.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.011129971s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
16382025-03-21T18:40:22.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.41859111s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
16392025-03-21T18:40:22.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.459437366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
16402025-03-21T18:40:22.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.035990567s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
16412025-03-21T18:40:23.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 730.117494ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16422025-03-21T18:40:23.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 805.141259ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16432025-03-21T18:40:23.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.036522107s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16442025-03-21T18:40:23.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.280621069s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
16452025-03-21T18:40:23.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 792.075517ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
16462025-03-21T18:40:23.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.356134454s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
16472025-03-21T18:40:23.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.110713257s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16482025-03-21T18:40:23.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.437576292s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
16492025-03-21T18:40:23.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.023650961s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
16502025-03-21T18:40:23.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.229555313s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
16512025-03-21T18:40:23.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.038471845s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16522025-03-21T18:40:23.822ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 839.734953ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
16532025-03-21T18:40:23.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.447730236s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
16542025-03-21T18:40:23.872ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 805.329255ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16552025-03-21T18:40:23.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 669.96635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16562025-03-21T18:40:23.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 994.781671ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
16572025-03-21T18:40:24.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 868.942106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
16582025-03-21T18:40:24.041ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.185394073s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
16592025-03-21T18:40:24.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 958.864311ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
16602025-03-21T18:40:24.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.178760069s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16612025-03-21T18:40:24.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 569.183066ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16622025-03-21T18:40:24.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.089023867s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
16632025-03-21T18:40:24.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.241720363s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
16642025-03-21T18:40:24.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 979.418551ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16652025-03-21T18:40:24.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 576.912572ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
16662025-03-21T18:40:24.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.106798013s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16672025-03-21T18:40:24.686ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.444239155s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
16682025-03-21T18:40:24.711ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52833
16692025-03-21T18:40:24.719ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3316 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52833 req_id = af601486-11da-45d8-9b96-bfb16ffd2037 response_code = 200 uri = /baseboard
16702025-03-21T18:40:24.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.419978991s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
16712025-03-21T18:40:24.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 753.606355ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16722025-03-21T18:40:24.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.043944658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
16732025-03-21T18:40:24.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 654.456715ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16742025-03-21T18:40:24.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 653.419492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16752025-03-21T18:40:24.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.288663585s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
16762025-03-21T18:40:24.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.350093587s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
16772025-03-21T18:40:24.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.046903641s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
16782025-03-21T18:40:25.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.198789401s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
16792025-03-21T18:40:25.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.450465187s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
16802025-03-21T18:40:25.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 1.485211689s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
16812025-03-21T18:40:25.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.475972182s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
16822025-03-21T18:40:25.317ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.373876836s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
16832025-03-21T18:40:25.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.414991547s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
16842025-03-21T18:40:25.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.42031285s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
16852025-03-21T18:40:25.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 504.889121ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16862025-03-21T18:40:25.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.384786239s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
16872025-03-21T18:40:25.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 588.292669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16882025-03-21T18:40:25.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 1.473539167s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
16892025-03-21T18:40:25.645ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.450878816s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
16902025-03-21T18:40:25.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.248958106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
16912025-03-21T18:40:25.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.30232161s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
16922025-03-21T18:40:26.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.255615906s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
16932025-03-21T18:40:26.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 1.238882583s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
16942025-03-21T18:40:26.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 985.874725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
16952025-03-21T18:40:26.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 916.94089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
16962025-03-21T18:40:26.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.482275578s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
16972025-03-21T18:40:26.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 535.768592ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
16982025-03-21T18:40:26.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 1.267138496s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
16992025-03-21T18:40:26.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.011555063s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
17002025-03-21T18:40:26.469ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.410359168s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
17012025-03-21T18:40:26.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.073245866s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
17022025-03-21T18:40:26.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 542.203501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
17032025-03-21T18:40:26.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.380214006s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
17042025-03-21T18:40:26.733ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 714.195941ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
17052025-03-21T18:40:26.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 978.731564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
17062025-03-21T18:40:26.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 1.308552005s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
17072025-03-21T18:40:26.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 696.140948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
17082025-03-21T18:40:26.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.208214645s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
17092025-03-21T18:40:26.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 555.975128ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
17102025-03-21T18:40:27.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 1.184656674s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
17112025-03-21T18:40:27.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 621.460307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
17122025-03-21T18:40:27.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.140053231s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
17132025-03-21T18:40:27.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91") failed: Property not found. retry in 1.124774613s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
17142025-03-21T18:40:27.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 1.410274029s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
17152025-03-21T18:40:27.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 842.705856ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
17162025-03-21T18:40:27.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 566.434396ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
17172025-03-21T18:40:27.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 765.583008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
17182025-03-21T18:40:27.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 556.318702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
17192025-03-21T18:40:27.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29") failed: Property not found. retry in 1.493980742s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
17202025-03-21T18:40:27.552ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b") failed: Property not found. retry in 1.085909637s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
17212025-03-21T18:40:27.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e") failed: Property not found. retry in 854.736605ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
17222025-03-21T18:40:27.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034") failed: Property not found. retry in 1.397422661s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
17232025-03-21T18:40:27.660ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b") failed: Property not found. retry in 1.089879305s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
17242025-03-21T18:40:27.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3") failed: Property not found. retry in 1.310395858s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
17252025-03-21T18:40:27.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357") failed: Property not found. retry in 1.439274403s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
17262025-03-21T18:40:27.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493") failed: Property not found. retry in 1.289255426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
17272025-03-21T18:40:27.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0") failed: Property not found. retry in 1.298368238s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
17282025-03-21T18:40:27.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775") failed: Property not found. retry in 1.003697162s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
17292025-03-21T18:40:28.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e") failed: Property not found. retry in 658.967681ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
17302025-03-21T18:40:28.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30") failed: Property not found. retry in 792.594907ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
17312025-03-21T18:40:28.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8") failed: Property not found. retry in 1.214681469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
17322025-03-21T18:40:28.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf") failed: Property not found. retry in 1.23883455s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
17332025-03-21T18:40:28.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330") failed: Property not found. retry in 681.23592ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
17342025-03-21T18:40:28.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 1.206004852s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
17352025-03-21T18:40:28.263ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786") failed: Property not found. retry in 1.069779343s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
17362025-03-21T18:40:28.598ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0") failed: Property not found. retry in 717.597395ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
17372025-03-21T18:40:29.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76") failed: Property not found. retry in 1.041296823s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
17382025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_143937aa-1662-4be7-b315-db1f929987b0
17392025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_6a3afce7-5bd8-41a1-9d14-68b9db589357
17402025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_7d216c11-4f13-431f-ab10-e98977a8f493
17412025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_c36ec202-8c35-4d6a-b1b3-9bac844d8fbf
17422025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_451fee58-0223-4990-affa-f574ce1ea6b3
17432025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_5d94b88f-d605-40ae-bdec-b8303d159330
17442025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_1f205a99-fd9d-4d22-94be-e3b9dc968775
17452025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_02fc0a56-1448-4d70-95c0-f34330562c4b
17462025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_3dfe96d0-d03b-4607-9cfe-63610e8dd6f8
17472025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_5a548b54-4b29-4bcd-a95c-aacf544dec91
17482025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_clickhouse_0e3eb50f-78e6-4909-9a08-8c652e364f76
17492025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_bb97e273-601a-4b5b-8732-e5ed62596034
17502025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_85a80821-afbd-49ef-b77b-803d4b5fb1e0
17512025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_oximeter_c9313efa-637b-46a6-8199-b515674fa14e
17522025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_630a8647-9e76-4241-8d2b-4ada315fec5b
17532025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_e7c0f996-ed3a-4dd0-a532-6e3c8a71193e
17542025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_96e4164c-0738-4ba7-90a0-766f377a7c30
17552025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_f1d166da-3cb7-4a30-8a48-52436a59fe29
17562025-03-21T18:40:30.554ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_3dd7c84f-f9bd-4152-b3bf-dd0998c69786
17572025-03-21T18:40:30.557ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17582025-03-21T18:40:30.565ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17592025-03-21T18:40:30.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35904701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44993 req_id = 3e85c0c2-1bdf-4e62-9d88-57f850cf7e3e response_code = 204 uri = /omicron-zones
17602025-03-21T18:40:30.599ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1468
17612025-03-21T18:40:30.641ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:857
17622025-03-21T18:40:30.644ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:870
17632025-03-21T18:40:30.695ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1070
17642025-03-21T18:40:31.774ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17652025-03-21T18:40:31.781ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.892242313s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
17662025-03-21T18:40:31.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17672025-03-21T18:40:31.924ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17682025-03-21T18:40:32.054ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17692025-03-21T18:40:32.183ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17702025-03-21T18:40:32.332ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17712025-03-21T18:40:32.533ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17722025-03-21T18:40:32.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17732025-03-21T18:40:32.983ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17742025-03-21T18:40:33.230ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17752025-03-21T18:40:33.743ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17762025-03-21T18:40:34.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17772025-03-21T18:40:35.190ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/824266aa-507b-4201-8ccd-ac7c6cbafcf0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17782025-03-21T18:40:36.433ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9ddee894-99a7-42ee-8ad6-4ab876e80467", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"824266aa-507b-4201-8ccd-ac7c6cbafcf0\"", request_id: "9ddee894-99a7-42ee-8ad6-4ab876e80467" } file = sled-agent/src/rack_setup/service.rs:1132
17792025-03-21T18:40:37.755ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1492016b-13db-4cd5-9428-2d2809ce9d4e", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"824266aa-507b-4201-8ccd-ac7c6cbafcf0\"", request_id: "1492016b-13db-4cd5-9428-2d2809ce9d4e" } file = sled-agent/src/rack_setup/service.rs:1132
17802025-03-21T18:40:37.796ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.828015608s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"4e511154-b850-41b2-b82c-b9504d873cca\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 21 Mar 2025 18:40:37 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"4e511154-b850-41b2-b82c-b9504d873cca\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
17812025-03-21T18:40:39.681ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b84f43b8-9640-411e-b028-cc17c01d6ad7", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "b84f43b8-9640-411e-b028-cc17c01d6ad7" } file = sled-agent/src/rack_setup/service.rs:1132
17822025-03-21T18:40:41.809ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5c87a0e1-27d0-4c2d-9aba-7582423c8ba2", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "5c87a0e1-27d0-4c2d-9aba-7582423c8ba2" } file = sled-agent/src/rack_setup/service.rs:1132
17832025-03-21T18:40:43.510ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "960ec834-4bcc-4baf-b743-4fc506a8ca24", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "960ec834-4bcc-4baf-b743-4fc506a8ca24" } file = sled-agent/src/rack_setup/service.rs:1132
17842025-03-21T18:40:45.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d0501108-df60-433e-9556-25eb3eaa1be5", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "d0501108-df60-433e-9556-25eb3eaa1be5" } file = sled-agent/src/rack_setup/service.rs:1132
17852025-03-21T18:40:49.317ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f2e58b98-52bd-48a9-8422-3d33c1d57b86", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "f2e58b98-52bd-48a9-8422-3d33c1d57b86" } file = sled-agent/src/rack_setup/service.rs:1132
17862025-03-21T18:40:54.319ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f25d0070-832b-4ce5-b156-99598bf94adc", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "f25d0070-832b-4ce5-b156-99598bf94adc" } file = sled-agent/src/rack_setup/service.rs:1132
17872025-03-21T18:40:54.755ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41955
17882025-03-21T18:40:54.755ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41955 req_id = c82d8f00-fdcb-4491-9027-9c36cef2894c response_code = 200 uri = /baseboard
17892025-03-21T18:40:58.504ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e53da312-26e0-4f2b-a59c-b372c66fbc3d", "content-length": "173", "date": "Fri, 21 Mar 2025 18:40:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "e53da312-26e0-4f2b-a59c-b372c66fbc3d" } file = sled-agent/src/rack_setup/service.rs:1132
17902025-03-21T18:41:05.261ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "285eb1fc-f04a-4d91-a746-e0cab44b4667", "content-length": "173", "date": "Fri, 21 Mar 2025 18:41:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"84074e7c-1a32-4c31-a122-c0b819b9b406\"", request_id: "285eb1fc-f04a-4d91-a746-e0cab44b4667" } file = sled-agent/src/rack_setup/service.rs:1132
17912025-03-21T18:41:08.886ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
17922025-03-21T18:41:09.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61928
17932025-03-21T18:41:09.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17942025-03-21T18:41:09.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17952025-03-21T18:41:09.327ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
17962025-03-21T18:41:09.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
17972025-03-21T18:41:09.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17982025-03-21T18:41:09.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_2219f396-1299-4176-91e7-626a9f13bedc
17992025-03-21T18:41:09.371ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18002025-03-21T18:41:09.371ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe
18012025-03-21T18:41:09.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18022025-03-21T18:41:09.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_93f27406-584f-49b0-bbdf-aec064c7573f
18032025-03-21T18:41:09.421ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18042025-03-21T18:41:09.421ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_47056192-ed60-41f0-aecf-23ae41e9cb50
18052025-03-21T18:41:09.445ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18062025-03-21T18:41:09.445ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb
18072025-03-21T18:41:09.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18082025-03-21T18:41:09.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba
18092025-03-21T18:41:09.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18102025-03-21T18:41:09.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9
18112025-03-21T18:41:09.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37587
18122025-03-21T18:41:09.507ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18132025-03-21T18:41:09.507ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18142025-03-21T18:41:09.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18152025-03-21T18:41:09.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18162025-03-21T18:41:09.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18172025-03-21T18:41:09.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18182025-03-21T18:41:09.508ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18192025-03-21T18:41:09.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37587 req_id = 2c2e5d0a-3130-4608-aaa7-dd8762ae6512 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18202025-03-21T18:41:09.510ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1142
18212025-03-21T18:41:09.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18222025-03-21T18:41:09.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_71dc428d-9d1f-483c-b923-af3efe9583af
18232025-03-21T18:41:09.520ZINFOSledAgent (RSS): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
18242025-03-21T18:41:09.520ZINFOSledAgent (RSS): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
18252025-03-21T18:41:09.534ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18262025-03-21T18:41:09.534ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_746ded48-1093-4fb4-a064-8507518ef38c
18272025-03-21T18:41:09.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61928 req_id = b8c69f00-0b67-41de-82f0-8f760116166c response_code = 200 uri = /inventory
18282025-03-21T18:41:10.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49212
18292025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18302025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18312025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18322025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18332025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18342025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18352025-03-21T18:41:10.057ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18362025-03-21T18:41:10.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49212 req_id = 810ca87d-76cd-4caa-9c43-9f9891abc915 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18372025-03-21T18:41:10.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64435
18382025-03-21T18:41:10.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18392025-03-21T18:41:10.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18402025-03-21T18:41:10.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
18412025-03-21T18:41:10.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
18422025-03-21T18:41:10.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18432025-03-21T18:41:10.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_2219f396-1299-4176-91e7-626a9f13bedc
18442025-03-21T18:41:10.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18452025-03-21T18:41:10.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe
18462025-03-21T18:41:10.177ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18472025-03-21T18:41:10.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_93f27406-584f-49b0-bbdf-aec064c7573f
18482025-03-21T18:41:10.199ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18492025-03-21T18:41:10.199ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_47056192-ed60-41f0-aecf-23ae41e9cb50
18502025-03-21T18:41:10.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18512025-03-21T18:41:10.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb
18522025-03-21T18:41:10.244ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18532025-03-21T18:41:10.244ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba
18542025-03-21T18:41:10.264ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18552025-03-21T18:41:10.264ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9
18562025-03-21T18:41:10.285ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18572025-03-21T18:41:10.285ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_71dc428d-9d1f-483c-b923-af3efe9583af
18582025-03-21T18:41:10.305ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18592025-03-21T18:41:10.306ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_746ded48-1093-4fb4-a064-8507518ef38c
18602025-03-21T18:41:10.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197711 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64435 req_id = 64e0af6f-45c7-41c6-9031-ad0495f511c2 response_code = 200 uri = /inventory
18612025-03-21T18:41:10.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41169
18622025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18632025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18662025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18672025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18682025-03-21T18:41:10.380ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18692025-03-21T18:41:10.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41169 req_id = 1a65c926-c7d0-4eaa-b43c-fc3052119021 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18702025-03-21T18:41:10.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35047
18712025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18722025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18732025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18742025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18752025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18762025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18772025-03-21T18:41:10.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18782025-03-21T18:41:10.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35047 req_id = 484bf96a-036c-437e-99af-7cc8fcf804e9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18792025-03-21T18:41:14.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54153
18802025-03-21T18:41:14.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54153 req_id = 143011e0-3647-4bff-93c8-1dbaaa3d8863 response_code = 200 uri = /vpc-routes
18812025-03-21T18:41:14.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
18822025-03-21T18:41:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 852 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54153 req_id = 23b314a1-0823-489f-be99-9e2f5ef0168d response_code = 204 uri = /eip-gateways
18832025-03-21T18:41:15.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2937 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54153 req_id = 66810ee7-2098-437f-b694-97a2016ef2ff response_code = 204 uri = /vpc-routes
18842025-03-21T18:41:21.271ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
18852025-03-21T18:41:21.271ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
18862025-03-21T18:41:21.271ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
18872025-03-21T18:41:21.271ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
18882025-03-21T18:41:24.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55219
18892025-03-21T18:41:24.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55219 req_id = 33423305-3fd9-4327-bf26-9bd654777bc2 response_code = 200 uri = /baseboard
18902025-03-21T18:41:28.408ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:38411 remote_addr = [fd00:1122:3344:101::d]:63395 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
18912025-03-21T18:41:28.448ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39163 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 4d13da48-4aed-4a8b-a74c-470bcd2ae251 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
18922025-03-21T18:41:38.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59018
18932025-03-21T18:41:38.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59018 req_id = ec22dee4-1edb-4c15-894f-7c95e15a0fef response_code = 200 uri = /vpc-routes
18942025-03-21T18:41:38.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
18952025-03-21T18:41:38.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59018 req_id = 94fe66d4-8ee4-42e2-bea6-837175af6480 response_code = 204 uri = /eip-gateways
18962025-03-21T18:41:38.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33372
18972025-03-21T18:41:38.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33372 req_id = 15f68f4a-4607-4d67-89c9-a818b068950e response_code = 200 uri = /vpc-routes
18982025-03-21T18:41:38.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59018 req_id = a7bef2ce-88f6-4ef7-a71f-c6457c76b4a4 response_code = 204 uri = /vpc-routes
18992025-03-21T18:41:38.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19002025-03-21T18:41:38.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33372 req_id = 58cc99de-e33b-4972-bbda-214f388c3558 response_code = 204 uri = /eip-gateways
19012025-03-21T18:41:38.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52730
19022025-03-21T18:41:38.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52730 req_id = b0b63703-4e1a-4591-a66f-7d3b2b2a5f19 response_code = 200 uri = /v2p
19032025-03-21T18:41:38.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37573
19042025-03-21T18:41:38.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37573 req_id = f945431c-fde9-4c52-98ee-9e588df5aace response_code = 200 uri = /v2p
19052025-03-21T18:41:38.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46921
19062025-03-21T18:41:38.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19072025-03-21T18:41:38.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19082025-03-21T18:41:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46921 req_id = 6712f1b7-9497-4a7c-806e-3c0f06cd6527 response_code = 204 uri = /switch-ports
19092025-03-21T18:41:39.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38321
19102025-03-21T18:41:39.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37361
19112025-03-21T18:41:39.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40188
19122025-03-21T18:41:39.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19132025-03-21T18:41:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8097 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46921 req_id = 1f26c864-e674-4f37-a83e-4eecbc433187 response_code = 200 uri = /network-bootstore-config
19142025-03-21T18:41:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7855 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38321 req_id = 0d039756-ab0b-42a3-ab42-20c193675bcf response_code = 200 uri = /vpc-routes
19152025-03-21T18:41:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8098 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33372 req_id = 996bee07-9e6a-4b67-a2b9-12e4d1f32695 response_code = 204 uri = /vpc-routes
19162025-03-21T18:41:39.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48563
19172025-03-21T18:41:39.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48563 req_id = ef73114d-d21b-44a9-844a-b31383d2fc22 response_code = 200 uri = /v2p
19182025-03-21T18:41:39.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19192025-03-21T18:41:39.147ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19202025-03-21T18:41:39.147ZINFOSledAgent (bootstore): Writing ledger to /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
19212025-03-21T18:41:39.156ZINFOSledAgent (bootstore): Writing ledger to /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
19222025-03-21T18:41:39.157ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19232025-03-21T18:41:39.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46921 req_id = a33d26ac-cfaa-4813-8c3f-7e0982d23846 response_code = 204 uri = /network-bootstore-config
19242025-03-21T18:41:39.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19252025-03-21T18:41:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38321 req_id = 3f07f5c0-de18-45be-a46f-c5bafc5ce0a4 response_code = 204 uri = /eip-gateways
19262025-03-21T18:41:39.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38321 req_id = 155cf3e9-5b67-4b86-9e4d-81fa6a8b461d response_code = 204 uri = /vpc-routes
19272025-03-21T18:41:39.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19282025-03-21T18:41:39.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40188 req_id = 5baf0e35-2b3b-4a90-b680-ff4eb6c05d07 response_code = 204 uri = /switch-ports
19292025-03-21T18:41:39.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40188 req_id = 1b5891e2-e355-4aa1-ba82-233c5423b665 response_code = 200 uri = /network-bootstore-config
19302025-03-21T18:41:39.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19312025-03-21T18:41:39.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37361 req_id = fae3253a-e67e-459d-b34c-7cba6ee504fd response_code = 204 uri = /switch-ports
19322025-03-21T18:41:39.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37361 req_id = 71d41bb9-8b92-42d9-ac97-a61fd7464acf response_code = 200 uri = /network-bootstore-config
19332025-03-21T18:41:54.828ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43755
19342025-03-21T18:41:54.828ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43755 req_id = da150c90-bb62-4a7d-b5f3-ce4125bf5ed6 response_code = 200 uri = /baseboard
19352025-03-21T18:41:58.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12796 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = a6ca6e3a-f664-4f89-9808-f76b938f73cb response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
19362025-03-21T18:42:08.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51933
19372025-03-21T18:42:08.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51933 req_id = a3b98214-d39e-447e-b237-4da2e1b996b2 response_code = 200 uri = /vpc-routes
19382025-03-21T18:42:08.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59828
19392025-03-21T18:42:08.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59828 req_id = a5f8a998-3311-4ed4-9d54-9c95bd23d84d response_code = 200 uri = /vpc-routes
19402025-03-21T18:42:08.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19412025-03-21T18:42:08.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59828 req_id = b0d3b96b-b656-48e4-b99d-2d554bbcd190 response_code = 204 uri = /eip-gateways
19422025-03-21T18:42:08.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19432025-03-21T18:42:08.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51933 req_id = 655e9d47-d79f-48f3-b2d1-d575bad1541b response_code = 204 uri = /eip-gateways
19442025-03-21T18:42:08.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52113
19452025-03-21T18:42:08.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52113 req_id = fbf976ca-4ad6-4227-b0f7-b658d74396b2 response_code = 200 uri = /vpc-routes
19462025-03-21T18:42:08.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37839
19472025-03-21T18:42:08.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19482025-03-21T18:42:08.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19492025-03-21T18:42:08.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110786 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37839 req_id = 2480d7e0-a75e-4daf-8c40-c8ee7f5c572d response_code = 204 uri = /switch-ports
19502025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63758
19512025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47478
19522025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40678
19532025-03-21T18:42:08.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19542025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52113 req_id = 4eb3dc85-32dc-43a7-affc-bb9e1cc1fb88 response_code = 204 uri = /eip-gateways
19552025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37839 req_id = dd2972ab-4247-4547-9407-7a697a48817d response_code = 200 uri = /network-bootstore-config
19562025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 714 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59828 req_id = 691b6ec3-cb81-4230-b987-3761a0a63394 response_code = 204 uri = /vpc-routes
19572025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40678 req_id = dcc39920-ae12-4501-b44f-4314e6af5637 response_code = 200 uri = /v2p
19582025-03-21T18:42:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 861 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51933 req_id = 18bfedfd-f0a8-419d-b89a-007830ba9025 response_code = 204 uri = /vpc-routes
19592025-03-21T18:42:08.764ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19602025-03-21T18:42:08.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47478 req_id = da8ae877-e046-42e1-bd97-631302ed2f9b response_code = 200 uri = /v2p
19612025-03-21T18:42:08.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41667
19622025-03-21T18:42:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41667 req_id = 2f7c54fd-b7ef-44e1-b8c6-986cdca8d40e response_code = 200 uri = /v2p
19632025-03-21T18:42:08.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19642025-03-21T18:42:08.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97988 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63758 req_id = 770f92c4-b8ee-410d-acaa-28fd2939c75c response_code = 204 uri = /switch-ports
19652025-03-21T18:42:08.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63758 req_id = 178a5ec3-5b16-45be-bb65-3ebc7d2a8058 response_code = 200 uri = /network-bootstore-config
19662025-03-21T18:42:08.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52113 req_id = c324530b-8782-4c63-8059-ce17eabb6686 response_code = 204 uri = /vpc-routes
19672025-03-21T18:42:08.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43883
19682025-03-21T18:42:08.891ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19692025-03-21T18:42:08.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19702025-03-21T18:42:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43883 req_id = 2b83bb3e-3a77-419a-b538-b51758b3bacf response_code = 204 uri = /switch-ports
19712025-03-21T18:42:08.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43883 req_id = 4ccad23b-6a6c-484b-8a7f-e71598e06875 response_code = 200 uri = /network-bootstore-config
19722025-03-21T18:42:21.271ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
19732025-03-21T18:42:21.272ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
19742025-03-21T18:42:21.272ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
19752025-03-21T18:42:21.272ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
19762025-03-21T18:42:24.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36956
19772025-03-21T18:42:24.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36956 req_id = 88545508-a72e-4017-a0f6-059662011373 response_code = 200 uri = /baseboard
19782025-03-21T18:42:28.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7947 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = da04a0d1-db1d-4884-9dc4-519f1ee68bc3 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
19792025-03-21T18:42:38.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48746
19802025-03-21T18:42:38.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48746 req_id = b5158bc7-0a87-45ce-b7f0-2957977dbdbd response_code = 200 uri = /vpc-routes
19812025-03-21T18:42:38.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59270
19822025-03-21T18:42:38.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59270 req_id = 7d74674d-0fb2-4e47-9545-a96e0eacce69 response_code = 200 uri = /vpc-routes
19832025-03-21T18:42:38.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19842025-03-21T18:42:38.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59270 req_id = 7404ad3b-bfa3-45b2-84d5-1058970fd132 response_code = 204 uri = /eip-gateways
19852025-03-21T18:42:38.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19862025-03-21T18:42:38.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48746 req_id = 9bf78da5-3284-4f9c-9b82-29436b8b0a2b response_code = 204 uri = /eip-gateways
19872025-03-21T18:42:38.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48746 req_id = 8ef497f7-c724-408f-846a-f979110a173b response_code = 204 uri = /vpc-routes
19882025-03-21T18:42:38.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59270 req_id = 6d715d0a-dfc0-4f8b-be88-4b1621ed68c5 response_code = 204 uri = /vpc-routes
19892025-03-21T18:42:38.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33531
19902025-03-21T18:42:38.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33531 req_id = ae1090ac-3f4e-469a-8b47-4c169b700afe response_code = 200 uri = /v2p
19912025-03-21T18:42:38.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39562
19922025-03-21T18:42:38.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39562 req_id = 8b2c2aae-0c11-4de5-9bb5-7e81bba32725 response_code = 200 uri = /v2p
19932025-03-21T18:42:38.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36357
19942025-03-21T18:42:38.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36357 req_id = fd81f006-8157-4867-a6cb-201ed59ca2f2 response_code = 200 uri = /vpc-routes
19952025-03-21T18:42:38.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
19962025-03-21T18:42:38.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 9b0ac44d-cb5b-4f09-acee-c30dd3cba3fe response_code = 204 uri = /eip-gateways
19972025-03-21T18:42:38.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36832
19982025-03-21T18:42:38.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19992025-03-21T18:42:38.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20002025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36832 req_id = d5831225-1e60-40da-b295-d5acace887ba response_code = 204 uri = /switch-ports
20012025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46204
20022025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46723
20032025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63092
20042025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 30804646-588c-4c66-a47f-b357a91d6eea response_code = 204 uri = /vpc-routes
20052025-03-21T18:42:39.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36832 req_id = 0f938aeb-9ae8-4bb2-a43d-6679f0cd59c9 response_code = 200 uri = /network-bootstore-config
20062025-03-21T18:42:39.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20072025-03-21T18:42:39.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63092 req_id = e6bb08f4-78a6-4d2e-85df-e7b83820a431 response_code = 200 uri = /v2p
20082025-03-21T18:42:39.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20092025-03-21T18:42:39.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20102025-03-21T18:42:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46204 req_id = 8c8a039f-7b55-42a7-847a-b85c84836b01 response_code = 204 uri = /switch-ports
20112025-03-21T18:42:39.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46204 req_id = 344d8c07-2f2b-480c-9534-a57ec89fd5b5 response_code = 200 uri = /network-bootstore-config
20122025-03-21T18:42:39.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20132025-03-21T18:42:39.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46723 req_id = fc56b2d9-4ffa-4db9-adf6-1a38e65c2bb8 response_code = 204 uri = /switch-ports
20142025-03-21T18:42:39.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46723 req_id = 5d470071-2fb2-4b71-bd2c-f5cce56cb927 response_code = 200 uri = /network-bootstore-config
20152025-03-21T18:42:54.900ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56115
20162025-03-21T18:42:54.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56115 req_id = 9c99df75-24eb-4c79-bf47-bec3e113fefd response_code = 200 uri = /baseboard
20172025-03-21T18:42:58.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8184 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 4b4b27cb-0f34-4acf-b278-785d4ef58013 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
20182025-03-21T18:43:08.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61073
20192025-03-21T18:43:08.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61073 req_id = 595cef46-9b80-4bd1-b78e-fcdf67ea008a response_code = 200 uri = /vpc-routes
20202025-03-21T18:43:08.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61184
20212025-03-21T18:43:08.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61184 req_id = 2a2b1c65-fc21-4bab-8186-fbb1e43a8393 response_code = 200 uri = /vpc-routes
20222025-03-21T18:43:08.619ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20232025-03-21T18:43:08.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61073 req_id = 21a623d0-d59d-4e6e-abb3-583168615ccf response_code = 204 uri = /eip-gateways
20242025-03-21T18:43:08.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61073 req_id = 67024b4c-7351-49d0-a010-0e48288834cf response_code = 204 uri = /vpc-routes
20252025-03-21T18:43:08.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20262025-03-21T18:43:08.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61184 req_id = 24dc241b-511c-4125-a9f7-68f1693ce0f9 response_code = 204 uri = /eip-gateways
20272025-03-21T18:43:08.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61184 req_id = 0accc396-abd9-4e69-82e8-ea8749266f24 response_code = 204 uri = /vpc-routes
20282025-03-21T18:43:08.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59595
20292025-03-21T18:43:08.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20302025-03-21T18:43:08.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20312025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59595 req_id = 8cdf7526-8e90-40a4-b919-41c55cfb0067 response_code = 204 uri = /switch-ports
20322025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55293
20332025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49709
20342025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59595 req_id = 53996062-564f-4e7a-9564-7dce0eef192c response_code = 200 uri = /network-bootstore-config
20352025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55293 req_id = c90d4fa9-a1c0-4fa5-b703-fd1f76b28665 response_code = 200 uri = /vpc-routes
20362025-03-21T18:43:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49709 req_id = e60f21e0-61e3-4a14-aa8c-5537952565da response_code = 200 uri = /v2p
20372025-03-21T18:43:08.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33506
20382025-03-21T18:43:08.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20392025-03-21T18:43:08.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20402025-03-21T18:43:08.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33506 req_id = c54ac067-cc87-421c-8855-b139fa46707f response_code = 204 uri = /switch-ports
20412025-03-21T18:43:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41120
20422025-03-21T18:43:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50904
20432025-03-21T18:43:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53052
20442025-03-21T18:43:08.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20452025-03-21T18:43:08.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55293 req_id = 4856108c-9278-4d3e-bd87-a9b1f207a93d response_code = 204 uri = /eip-gateways
20462025-03-21T18:43:08.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33506 req_id = a0ec7df0-c0ef-4cdf-92eb-043dfdf927a9 response_code = 200 uri = /network-bootstore-config
20472025-03-21T18:43:08.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20482025-03-21T18:43:08.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41120 req_id = 1279b388-2432-4912-ab58-e1163fd804c3 response_code = 200 uri = /v2p
20492025-03-21T18:43:08.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53052 req_id = 99c1e65d-7058-435a-8f8a-9935d7092ed7 response_code = 200 uri = /v2p
20502025-03-21T18:43:08.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20512025-03-21T18:43:09.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97483 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50904 req_id = a164d0f0-36e0-407d-a906-e22deb3f166b response_code = 204 uri = /switch-ports
20522025-03-21T18:43:09.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50904 req_id = a3eb88d1-0f4d-406c-84d3-0eaf4f7c2914 response_code = 200 uri = /network-bootstore-config
20532025-03-21T18:43:09.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55293 req_id = 2ad0d572-2cb4-40de-8adf-e13e7f4c3b23 response_code = 204 uri = /vpc-routes
20542025-03-21T18:43:21.272ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
20552025-03-21T18:43:21.272ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
20562025-03-21T18:43:21.272ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
20572025-03-21T18:43:21.272ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
20582025-03-21T18:43:24.934ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62471
20592025-03-21T18:43:24.934ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62471 req_id = 0379aaa3-6e57-4779-92cf-1fdca3adb4fb response_code = 200 uri = /baseboard
20602025-03-21T18:43:28.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7687 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = c1450321-4cc5-4597-a488-9ef753c49bec response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
20612025-03-21T18:43:37.283ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
20622025-03-21T18:43:38.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46343
20632025-03-21T18:43:38.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46343 req_id = f2be17b9-0e2d-424f-a8ab-e96fa9732847 response_code = 200 uri = /vpc-routes
20642025-03-21T18:43:38.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37584
20652025-03-21T18:43:38.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37584 req_id = a255fede-c80e-4378-a3c6-6633bc8f399e response_code = 200 uri = /vpc-routes
20662025-03-21T18:43:38.874ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20672025-03-21T18:43:38.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46343 req_id = e5602d1f-1f29-4d7b-990c-b708445b4235 response_code = 204 uri = /eip-gateways
20682025-03-21T18:43:38.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46343 req_id = 4a0c2f08-f100-437c-893e-511caf5e7de0 response_code = 204 uri = /vpc-routes
20692025-03-21T18:43:38.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60422
20702025-03-21T18:43:38.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60422 req_id = 89a03c41-8629-4359-b284-73cd7619c37a response_code = 200 uri = /vpc-routes
20712025-03-21T18:43:38.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20722025-03-21T18:43:38.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60422 req_id = 8db05550-0d8e-4a03-b89d-632d354f8bb3 response_code = 204 uri = /eip-gateways
20732025-03-21T18:43:38.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60422 req_id = e38a0824-3807-470e-9e2e-915fd6b0ba20 response_code = 204 uri = /vpc-routes
20742025-03-21T18:43:38.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59016
20752025-03-21T18:43:38.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59016 req_id = 862be84c-f65c-4d3c-8151-1182895040a3 response_code = 200 uri = /v2p
20762025-03-21T18:43:38.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63298
20772025-03-21T18:43:38.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63298 req_id = c94a5eb4-8077-40bf-9950-9ebf3227a6eb response_code = 200 uri = /v2p
20782025-03-21T18:43:39.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41927
20792025-03-21T18:43:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41927 req_id = 5bb4e0ee-6fda-43dc-bb6f-d0214c00b570 response_code = 200 uri = /v2p
20802025-03-21T18:43:39.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44026
20812025-03-21T18:43:39.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20822025-03-21T18:43:39.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20832025-03-21T18:43:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44026 req_id = 9a4c266b-323c-4760-a893-787d21ef724a response_code = 204 uri = /switch-ports
20842025-03-21T18:43:39.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57896
20852025-03-21T18:43:39.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
20862025-03-21T18:43:39.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44026 req_id = 4eec2a78-73fa-4d15-aca3-fa7c00f51b57 response_code = 200 uri = /network-bootstore-config
20872025-03-21T18:43:39.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20882025-03-21T18:43:39.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37584 req_id = 75baa4d9-8ca1-4352-8fd8-b97256a4e453 response_code = 204 uri = /eip-gateways
20892025-03-21T18:43:39.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3839 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37584 req_id = f6b73993-5f83-436b-abe4-f1f5e5163241 response_code = 204 uri = /vpc-routes
20902025-03-21T18:43:39.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20912025-03-21T18:43:39.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33167
20922025-03-21T18:43:39.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20932025-03-21T18:43:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57896 req_id = ff2340d4-4c3b-488c-956e-9489a99b3f39 response_code = 204 uri = /switch-ports
20942025-03-21T18:43:39.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57896 req_id = fc03ad46-75e4-4c07-8e5e-7243a9587364 response_code = 200 uri = /network-bootstore-config
20952025-03-21T18:43:39.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20962025-03-21T18:43:39.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33167 req_id = 6f462e0f-da77-4dc4-8033-41d95a5b8552 response_code = 204 uri = /switch-ports
20972025-03-21T18:43:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33167 req_id = e19fa7fa-746e-4112-b62e-6eb5d0903606 response_code = 200 uri = /network-bootstore-config
20982025-03-21T18:43:54.970ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56481
20992025-03-21T18:43:54.970ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56481 req_id = 68b27787-efd6-4f06-bd48-695522243167 response_code = 200 uri = /baseboard
21002025-03-21T18:43:58.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7359 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = cdcfd263-d1a3-4919-880d-4f5cd067dd9d response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
21012025-03-21T18:44:08.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53477
21022025-03-21T18:44:08.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53477 req_id = 6f764763-d3d8-4643-adf0-04604feac16a response_code = 200 uri = /vpc-routes
21032025-03-21T18:44:08.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46324
21042025-03-21T18:44:08.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46324 req_id = c9b96435-4aae-4e28-b873-c32fc39fa191 response_code = 200 uri = /vpc-routes
21052025-03-21T18:44:08.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21062025-03-21T18:44:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53477 req_id = da4f2841-cbc6-47d2-b1d9-11b6f7e25c03 response_code = 204 uri = /eip-gateways
21072025-03-21T18:44:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53477 req_id = d79c4f4f-967c-43bc-a9a7-d816b75dd4ac response_code = 204 uri = /vpc-routes
21082025-03-21T18:44:08.592ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21092025-03-21T18:44:08.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46324 req_id = 7fb2733f-1edd-499b-9050-8e070c3c092e response_code = 204 uri = /eip-gateways
21102025-03-21T18:44:08.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46324 req_id = a0998cab-ef9a-4a67-a9a6-40c75920f6b4 response_code = 204 uri = /vpc-routes
21112025-03-21T18:44:08.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53120
21122025-03-21T18:44:08.608ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21132025-03-21T18:44:08.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21142025-03-21T18:44:08.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53120 req_id = 40a84bf3-b517-42be-a99c-d206f9b45e32 response_code = 204 uri = /switch-ports
21152025-03-21T18:44:08.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54977
21162025-03-21T18:44:08.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45312
21172025-03-21T18:44:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54977 req_id = 2f54153c-5978-40b8-8a02-3f84486c592c response_code = 200 uri = /vpc-routes
21182025-03-21T18:44:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53120 req_id = 8679cd6d-ab3e-4c3d-9c37-1f20951440d7 response_code = 200 uri = /network-bootstore-config
21192025-03-21T18:44:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45312 req_id = 3a4677b3-e183-4459-974e-45328a446701 response_code = 200 uri = /v2p
21202025-03-21T18:44:08.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21212025-03-21T18:44:08.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54977 req_id = b1e37c17-a40b-41f4-b522-11d1e300fe59 response_code = 204 uri = /eip-gateways
21222025-03-21T18:44:08.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54977 req_id = 9e2bd829-288c-4a66-b0bc-282bf4fec04f response_code = 204 uri = /vpc-routes
21232025-03-21T18:44:08.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48904
21242025-03-21T18:44:08.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21252025-03-21T18:44:08.793ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21262025-03-21T18:44:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48904 req_id = dd37dd58-1d8f-4b1d-9001-6d5a80157a29 response_code = 204 uri = /switch-ports
21272025-03-21T18:44:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35588
21282025-03-21T18:44:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43591
21292025-03-21T18:44:08.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57284
21302025-03-21T18:44:08.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48904 req_id = af4d6cba-c289-4b05-b242-067b00cbb955 response_code = 200 uri = /network-bootstore-config
21312025-03-21T18:44:08.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21322025-03-21T18:44:08.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35588 req_id = aa86a87f-c034-4203-96e8-e0834855f0d1 response_code = 200 uri = /v2p
21332025-03-21T18:44:08.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43591 req_id = 89f5355a-06cc-4793-86cf-3ddf6ff3148b response_code = 200 uri = /v2p
21342025-03-21T18:44:08.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21352025-03-21T18:44:08.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109550 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57284 req_id = 520cdb85-e998-4f1d-b179-f14444061618 response_code = 204 uri = /switch-ports
21362025-03-21T18:44:08.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57284 req_id = d9aa4014-9aaa-4420-9f1e-09417294794e response_code = 200 uri = /network-bootstore-config
21372025-03-21T18:44:21.272ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
21382025-03-21T18:44:21.272ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
21392025-03-21T18:44:21.272ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
21402025-03-21T18:44:21.273ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
21412025-03-21T18:44:25.004ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47476
21422025-03-21T18:44:25.004ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47476 req_id = 966748ce-6038-4212-9ec8-c470300ab5c4 response_code = 200 uri = /baseboard
21432025-03-21T18:44:28.416ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7063 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = b06e5575-d591-4ef9-ae4e-3b5d62cb822d response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
21442025-03-21T18:44:38.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42173
21452025-03-21T18:44:38.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42173 req_id = 087482d4-4341-4f9d-9e21-51175564bc92 response_code = 200 uri = /vpc-routes
21462025-03-21T18:44:38.756ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21472025-03-21T18:44:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42173 req_id = 2c2bdefe-6845-4c09-9b06-188116e854fc response_code = 204 uri = /eip-gateways
21482025-03-21T18:44:38.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54378
21492025-03-21T18:44:38.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54378 req_id = 3c982bd3-b2fb-41c0-a667-2ddb45cd06b7 response_code = 200 uri = /v2p
21502025-03-21T18:44:38.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42173 req_id = 3c9ab7f8-5267-404b-8cad-b42575ed4d61 response_code = 204 uri = /vpc-routes
21512025-03-21T18:44:38.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45450
21522025-03-21T18:44:38.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45450 req_id = eac25609-f077-420a-b32a-c96345699ec7 response_code = 200 uri = /vpc-routes
21532025-03-21T18:44:38.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21542025-03-21T18:44:38.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45450 req_id = db659f0b-62bb-4051-b937-f32b173164d0 response_code = 204 uri = /eip-gateways
21552025-03-21T18:44:38.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37991
21562025-03-21T18:44:38.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37991 req_id = 2ced3a90-1c7b-4350-9903-bfd5c5067ded response_code = 200 uri = /vpc-routes
21572025-03-21T18:44:38.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45450 req_id = 1cf030cd-2baa-4c97-a770-13c9493c71b0 response_code = 204 uri = /vpc-routes
21582025-03-21T18:44:38.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52563
21592025-03-21T18:44:38.869ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21602025-03-21T18:44:38.912ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21612025-03-21T18:44:38.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52563 req_id = 7ceec9c3-7f94-480f-bf5b-14456ef486ca response_code = 204 uri = /switch-ports
21622025-03-21T18:44:38.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33487
21632025-03-21T18:44:38.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57103
21642025-03-21T18:44:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57103 req_id = e4f61fed-5ac2-47db-add0-be9d813ce305 response_code = 200 uri = /v2p
21652025-03-21T18:44:38.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21662025-03-21T18:44:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52563 req_id = a528dc84-9592-4187-9f48-8176036ac714 response_code = 200 uri = /network-bootstore-config
21672025-03-21T18:44:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37991 req_id = 4117c54d-04df-42a6-a7aa-4b61e515f4af response_code = 204 uri = /eip-gateways
21682025-03-21T18:44:38.973ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21692025-03-21T18:44:39.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21702025-03-21T18:44:39.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33487 req_id = 1c12a3a8-d44c-4ae3-ac06-7ea875a8eb89 response_code = 204 uri = /switch-ports
21712025-03-21T18:44:39.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33487 req_id = dc5dd981-c4d3-4d86-b5e8-9003ad00b063 response_code = 200 uri = /network-bootstore-config
21722025-03-21T18:44:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52154
21732025-03-21T18:44:39.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52154 req_id = 769db3f2-aead-4c08-ac1a-972fe8e4d983 response_code = 200 uri = /v2p
21742025-03-21T18:44:39.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37991 req_id = 4a52e75b-a2cb-41a8-a9b6-f7fba0268693 response_code = 204 uri = /vpc-routes
21752025-03-21T18:44:39.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55706
21762025-03-21T18:44:39.096ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21772025-03-21T18:44:39.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21782025-03-21T18:44:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55706 req_id = 2859eea1-de61-4885-a202-c40555e76b17 response_code = 204 uri = /switch-ports
21792025-03-21T18:44:39.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55706 req_id = d0676a00-479f-499e-8400-aa9cc0866fbf response_code = 200 uri = /network-bootstore-config
21802025-03-21T18:44:55.039ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46998
21812025-03-21T18:44:55.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46998 req_id = 71493513-cc6d-4209-912d-f7b782f477cf response_code = 200 uri = /baseboard
21822025-03-21T18:44:58.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7495 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 0e5dfddf-91ef-4e95-a1b4-f7ee16446931 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
21832025-03-21T18:45:08.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43522
21842025-03-21T18:45:08.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43522 req_id = 6432cab2-ed05-4e19-91e2-c30a25cf9ab6 response_code = 200 uri = /vpc-routes
21852025-03-21T18:45:08.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36053
21862025-03-21T18:45:08.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36053 req_id = a48430ea-e5c9-40f3-84d3-5fb88ce53e94 response_code = 200 uri = /vpc-routes
21872025-03-21T18:45:08.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21882025-03-21T18:45:08.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36053 req_id = f35ebe07-9138-4803-a5e8-831f3a52e37d response_code = 204 uri = /eip-gateways
21892025-03-21T18:45:08.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56425
21902025-03-21T18:45:08.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56425 req_id = 55d399b3-80e5-487e-bd8d-2d9915c9bc35 response_code = 200 uri = /vpc-routes
21912025-03-21T18:45:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36053 req_id = 0927003a-8387-4a9e-ac93-4ebe3d52c6a0 response_code = 204 uri = /vpc-routes
21922025-03-21T18:45:08.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
21932025-03-21T18:45:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43522 req_id = e859139d-bfcb-4c19-bba5-fd19c1631f89 response_code = 204 uri = /eip-gateways
21942025-03-21T18:45:08.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43522 req_id = ab70e810-0202-48b6-bf94-c4a28b459f99 response_code = 204 uri = /vpc-routes
21952025-03-21T18:45:08.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43459
21962025-03-21T18:45:08.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21972025-03-21T18:45:08.728ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21982025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43459 req_id = 149bebe7-6fce-42fb-91e8-c131d4a4625e response_code = 204 uri = /switch-ports
21992025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57743
22002025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38492
22012025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38263
22022025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46914
22032025-03-21T18:45:08.792ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
22042025-03-21T18:45:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56425 req_id = 10394b7f-a3a6-413b-87b3-a0ebb28f24bb response_code = 204 uri = /eip-gateways
22052025-03-21T18:45:08.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22062025-03-21T18:45:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57743 req_id = dddfd70b-982d-4f01-84d1-8b010285ed68 response_code = 200 uri = /v2p
22072025-03-21T18:45:08.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4909 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43459 req_id = 60f7c3b4-3475-497c-b144-32db08c1b221 response_code = 200 uri = /network-bootstore-config
22082025-03-21T18:45:08.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63214
22092025-03-21T18:45:08.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38492 req_id = 30c65145-1765-49b5-8061-a333d4fd59a0 response_code = 200 uri = /v2p
22102025-03-21T18:45:08.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63214 req_id = 4ff80cc0-94e2-4612-a39e-400d431cc1b6 response_code = 200 uri = /v2p
22112025-03-21T18:45:08.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 611 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56425 req_id = b88258e6-c6c2-4312-a7cc-ff9271511d6c response_code = 204 uri = /vpc-routes
22122025-03-21T18:45:08.831ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22132025-03-21T18:45:08.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22142025-03-21T18:45:08.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46914 req_id = 9fddfa5e-ce40-4575-8a5c-2c3232e16d8b response_code = 204 uri = /switch-ports
22152025-03-21T18:45:08.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46914 req_id = 79a79a9e-261c-427a-a62c-dde50c8eaf86 response_code = 200 uri = /network-bootstore-config
22162025-03-21T18:45:08.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22172025-03-21T18:45:08.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38263 req_id = daeb7176-1ca8-4447-a7fb-25314dabc0d6 response_code = 204 uri = /switch-ports
22182025-03-21T18:45:08.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38263 req_id = a6fccf7f-3c42-425b-9b13-1bdc375f48f0 response_code = 200 uri = /network-bootstore-config
22192025-03-21T18:45:21.273ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
22202025-03-21T18:45:21.273ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
22212025-03-21T18:45:21.273ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
22222025-03-21T18:45:21.273ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
22232025-03-21T18:45:25.073ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50643
22242025-03-21T18:45:25.074ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50643 req_id = cc0305ee-7f7b-453d-83f7-5095cf5dc83e response_code = 200 uri = /baseboard
22252025-03-21T18:45:28.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7686 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = c3e472e8-e4b9-4d8d-aeb9-aa28594e6712 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
22262025-03-21T18:45:38.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39992
22272025-03-21T18:45:38.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39992 req_id = e4c0a55b-c1c8-484d-a466-77242396fd54 response_code = 200 uri = /vpc-routes
22282025-03-21T18:45:38.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43500
22292025-03-21T18:45:38.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22302025-03-21T18:45:38.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43500 req_id = 10fa9229-8ed5-489d-85d1-9227736f8c46 response_code = 200 uri = /artifacts
22312025-03-21T18:45:38.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56173
22322025-03-21T18:45:38.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56173 req_id = 598ad68f-740a-439c-a499-105e07f22d45 response_code = 200 uri = /vpc-routes
22332025-03-21T18:45:38.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
22342025-03-21T18:45:38.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39992 req_id = 6f68f665-2d25-4f7e-886e-120fe8e07672 response_code = 204 uri = /eip-gateways
22352025-03-21T18:45:38.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60518
22362025-03-21T18:45:38.837ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22372025-03-21T18:45:38.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60518 req_id = 65270e91-1c1f-473d-b718-7b0e5cf69cb4 response_code = 200 uri = /artifacts
22382025-03-21T18:45:38.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41919
22392025-03-21T18:45:38.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41919 req_id = 9aeb3178-87e4-42f0-a94e-a11dd2ee948d response_code = 200 uri = /vpc-routes
22402025-03-21T18:45:38.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39992 req_id = 128798ff-1c3a-42d8-aae6-58c4dd7aa543 response_code = 204 uri = /vpc-routes
22412025-03-21T18:45:38.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
22422025-03-21T18:45:38.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56173 req_id = f40f0122-9c69-435f-a43a-91a354608ce1 response_code = 204 uri = /eip-gateways
22432025-03-21T18:45:38.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
22442025-03-21T18:45:38.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41919 req_id = 13d15f30-41be-4de0-8a96-1bd610d61db4 response_code = 204 uri = /eip-gateways
22452025-03-21T18:45:38.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41919 req_id = 6848558b-2e94-4b78-b2a9-4e2f60495292 response_code = 204 uri = /vpc-routes
22462025-03-21T18:45:38.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63352
22472025-03-21T18:45:38.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63352 req_id = 2513bccd-8dc4-4c9f-a85f-616fbe566a72 response_code = 200 uri = /v2p
22482025-03-21T18:45:38.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56173 req_id = 19d6b4c4-a2ad-4ba7-b496-1ef7fda4f8b4 response_code = 204 uri = /vpc-routes
22492025-03-21T18:45:39.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55197
22502025-03-21T18:45:39.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22512025-03-21T18:45:39.060ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22522025-03-21T18:45:39.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55197 req_id = dc3c73b0-3b4c-4f0b-807c-b9b5870fea1a response_code = 204 uri = /switch-ports
22532025-03-21T18:45:39.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41825
22542025-03-21T18:45:39.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56421
22552025-03-21T18:45:39.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44550
22562025-03-21T18:45:39.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38859
22572025-03-21T18:45:39.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55197 req_id = 5aec2b98-08d7-43f9-b4dd-c77bc92c27cf response_code = 200 uri = /network-bootstore-config
22582025-03-21T18:45:39.138ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22592025-03-21T18:45:39.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22602025-03-21T18:45:39.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 749dc343-e369-437e-96cc-6d3916327c6e response_code = 200 uri = /v2p
22612025-03-21T18:45:39.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5931 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56421 req_id = 724cd623-954c-4679-9e30-10415b4c9825 response_code = 200 uri = /artifacts
22622025-03-21T18:45:39.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58032
22632025-03-21T18:45:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58032 req_id = 6c2ee102-c073-4b0f-b321-e9819dbf3af8 response_code = 200 uri = /v2p
22642025-03-21T18:45:39.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65407
22652025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22662025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22672025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22682025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22692025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22702025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22712025-03-21T18:45:39.178ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22722025-03-21T18:45:39.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65407 req_id = 7cb5633a-5cc0-44fe-992e-26d45f3323cb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22732025-03-21T18:45:39.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22742025-03-21T18:45:39.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36258
22752025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22762025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22772025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22782025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22792025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22802025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22812025-03-21T18:45:39.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22822025-03-21T18:45:39.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36258 req_id = b2bbb3bd-b163-4797-962a-c6fa1925218b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22832025-03-21T18:45:39.241ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22842025-03-21T18:45:39.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41825 req_id = bbf85d28-4b45-4950-8e93-7ea64132bb31 response_code = 204 uri = /switch-ports
22852025-03-21T18:45:39.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 724 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41825 req_id = ad7b48fc-4479-4a27-af64-233fa60babe2 response_code = 200 uri = /network-bootstore-config
22862025-03-21T18:45:39.279ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22872025-03-21T18:45:39.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44550 req_id = c09e6e86-eafd-4b86-ac16-36ba58dd1d33 response_code = 204 uri = /switch-ports
22882025-03-21T18:45:39.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44550 req_id = 1f5415e1-ed62-4842-b95b-ecea33a2789d response_code = 200 uri = /network-bootstore-config
22892025-03-21T18:45:39.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65441
22902025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22912025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22922025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22932025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22942025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22952025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22962025-03-21T18:45:39.426ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22972025-03-21T18:45:39.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65441 req_id = bca21669-56c2-4f72-aff2-91af8a73a606 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22982025-03-21T18:45:55.108ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57631
22992025-03-21T18:45:55.108ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57631 req_id = 252977d4-84ed-4bfd-b673-153690eb8215 response_code = 200 uri = /baseboard
23002025-03-21T18:45:58.417ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7062 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 3e6f5f71-6b1c-4716-85c4-b35d62c4ed12 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
23012025-03-21T18:46:08.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52496
23022025-03-21T18:46:08.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52496 req_id = c8a5ebfa-db93-4e4f-961a-260f15568949 response_code = 200 uri = /vpc-routes
23032025-03-21T18:46:08.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23042025-03-21T18:46:08.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52496 req_id = 1dbb8be3-f48c-4a60-8d39-fc63635aded5 response_code = 204 uri = /eip-gateways
23052025-03-21T18:46:08.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52496 req_id = 391ed7d6-0854-45e3-bbe4-e72202c83e0c response_code = 204 uri = /vpc-routes
23062025-03-21T18:46:08.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65031
23072025-03-21T18:46:08.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65031 req_id = 889a7519-4a5b-4733-94ec-7761bf2042d6 response_code = 200 uri = /vpc-routes
23082025-03-21T18:46:08.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43343
23092025-03-21T18:46:08.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43343 req_id = 34204569-f67c-4baf-9ef1-c249d9c77baf response_code = 200 uri = /v2p
23102025-03-21T18:46:08.637ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23112025-03-21T18:46:08.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65031 req_id = a2323f1d-b55d-478d-983e-a140ae5b463c response_code = 204 uri = /eip-gateways
23122025-03-21T18:46:08.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64192
23132025-03-21T18:46:08.642ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23142025-03-21T18:46:08.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23152025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64192 req_id = 2550e8fa-444a-4e43-b0a0-abc8b9732c42 response_code = 204 uri = /switch-ports
23162025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35877
23172025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42979
23182025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64192 req_id = 4f5e880d-44ae-4570-863c-a5c10e7b319c response_code = 200 uri = /network-bootstore-config
23192025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57983
23202025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55004
23212025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65031 req_id = 68b51601-691a-40d4-a435-90d9dd3e349b response_code = 204 uri = /vpc-routes
23222025-03-21T18:46:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42979 req_id = f13ffa99-075d-4504-a693-9837ba98d1e8 response_code = 200 uri = /vpc-routes
23232025-03-21T18:46:08.751ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23242025-03-21T18:46:08.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55004 req_id = 67a79ac3-54f6-44e7-9f31-058f11205051 response_code = 200 uri = /v2p
23252025-03-21T18:46:08.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3887 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35877 req_id = 9eb643a9-f81b-4426-94be-1a34dd053536 response_code = 200 uri = /v2p
23262025-03-21T18:46:08.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49258
23272025-03-21T18:46:08.788ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23282025-03-21T18:46:08.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23292025-03-21T18:46:08.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42979 req_id = 02279cf0-34ed-4de3-9772-6104ed7ca41f response_code = 204 uri = /eip-gateways
23302025-03-21T18:46:08.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42979 req_id = e0e363a2-f3fe-4626-83f9-2c9724551487 response_code = 204 uri = /vpc-routes
23312025-03-21T18:46:08.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23322025-03-21T18:46:08.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57983 req_id = f9b733de-9114-4b67-808f-6ee5bee7a382 response_code = 204 uri = /switch-ports
23332025-03-21T18:46:08.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57983 req_id = c8213b37-1308-498a-a634-f71e21baee87 response_code = 200 uri = /network-bootstore-config
23342025-03-21T18:46:08.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23352025-03-21T18:46:08.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49258 req_id = 2868bf45-17a0-484e-81bd-e82685548c5f response_code = 204 uri = /switch-ports
23362025-03-21T18:46:08.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49258 req_id = 1606be47-d6e5-4170-bedd-34178e48b169 response_code = 200 uri = /network-bootstore-config
23372025-03-21T18:46:21.274ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
23382025-03-21T18:46:21.275ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
23392025-03-21T18:46:21.275ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
23402025-03-21T18:46:21.275ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
23412025-03-21T18:46:25.141ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57918
23422025-03-21T18:46:25.141ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57918 req_id = f309b661-79f2-4b64-ac2e-37f708045e21 response_code = 200 uri = /baseboard
23432025-03-21T18:46:28.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7880 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 699540b0-7587-4450-a2a5-35e4bea26df7 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
23442025-03-21T18:46:38.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61080
23452025-03-21T18:46:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61080 req_id = af6f9a7c-049e-48ca-92db-5cc044a6b1cd response_code = 200 uri = /vpc-routes
23462025-03-21T18:46:38.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23472025-03-21T18:46:38.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61080 req_id = 3db1606d-cab0-493e-b7b7-4c3173616e89 response_code = 204 uri = /eip-gateways
23482025-03-21T18:46:38.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61080 req_id = ced52916-a4a5-45fe-8748-7c594b9fac1a response_code = 204 uri = /vpc-routes
23492025-03-21T18:46:38.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63715
23502025-03-21T18:46:38.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63715 req_id = 9488354d-7693-4c94-8ef0-eda0b54c9425 response_code = 200 uri = /v2p
23512025-03-21T18:46:38.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63090
23522025-03-21T18:46:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63090 req_id = 8306a820-70dd-47e6-b64e-a5313156a33a response_code = 200 uri = /vpc-routes
23532025-03-21T18:46:38.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60102
23542025-03-21T18:46:38.843ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23552025-03-21T18:46:38.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23562025-03-21T18:46:38.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60102 req_id = ae57c678-1056-4789-b363-887ec15c84f3 response_code = 204 uri = /switch-ports
23572025-03-21T18:46:38.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55342
23582025-03-21T18:46:38.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57523
23592025-03-21T18:46:38.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23602025-03-21T18:46:38.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60102 req_id = d49d82d2-00a6-4a0c-bb61-9422b3b51cc6 response_code = 200 uri = /network-bootstore-config
23612025-03-21T18:46:38.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63090 req_id = a2cc7ce5-e13c-413c-b8a4-9dde6bb3e371 response_code = 204 uri = /eip-gateways
23622025-03-21T18:46:38.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55342 req_id = 6a73e05f-ce04-410a-af04-ca769945e0f1 response_code = 200 uri = /vpc-routes
23632025-03-21T18:46:38.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57523 req_id = 1fce96a6-e485-43f3-94ea-bd7240f34d5c response_code = 200 uri = /v2p
23642025-03-21T18:46:38.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23652025-03-21T18:46:38.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55342 req_id = 1b3e64d6-bf26-4e55-8039-998c7d4bfba1 response_code = 204 uri = /eip-gateways
23662025-03-21T18:46:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55342 req_id = 2e0d889f-7047-4795-b242-0b57a1144e30 response_code = 204 uri = /vpc-routes
23672025-03-21T18:46:38.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45378
23682025-03-21T18:46:38.997ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23692025-03-21T18:46:39.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23702025-03-21T18:46:39.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45378 req_id = 4dcc11d9-79b7-45fe-913c-1f4eb964dd50 response_code = 204 uri = /switch-ports
23712025-03-21T18:46:39.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45378 req_id = 74f4cc64-953d-490b-8e6c-f84b3de0c52e response_code = 200 uri = /network-bootstore-config
23722025-03-21T18:46:39.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43333
23732025-03-21T18:46:39.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43333 req_id = a85258ae-f89d-4db7-a2d1-e4c5295b066c response_code = 200 uri = /v2p
23742025-03-21T18:46:39.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63090 req_id = 0297adb6-e12e-49e7-8301-b02f191127d8 response_code = 204 uri = /vpc-routes
23752025-03-21T18:46:39.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42892
23762025-03-21T18:46:39.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23772025-03-21T18:46:39.251ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23782025-03-21T18:46:39.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42892 req_id = bcdc093f-ffe3-4211-a41c-02f3a3c5d605 response_code = 204 uri = /switch-ports
23792025-03-21T18:46:39.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42892 req_id = f58790bc-6f2a-4f4f-b50e-a4027636b868 response_code = 200 uri = /network-bootstore-config
23802025-03-21T18:46:55.174ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32944
23812025-03-21T18:46:55.174ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32944 req_id = 665b996c-bbd8-4416-8990-8146460a2c74 response_code = 200 uri = /baseboard
23822025-03-21T18:46:58.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7348 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = ec77a81a-6aa5-44c0-b6c2-4d6cd1a950b7 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
23832025-03-21T18:47:08.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33640
23842025-03-21T18:47:08.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33640 req_id = cbd00a82-86c6-43b2-9523-57fed33b32b0 response_code = 200 uri = /vpc-routes
23852025-03-21T18:47:08.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23862025-03-21T18:47:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33640 req_id = 6a420dec-09b8-46bf-b58a-f9ca23c4e351 response_code = 204 uri = /eip-gateways
23872025-03-21T18:47:08.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33640 req_id = 11c38b92-33f6-426d-99ae-7df68f84dbe7 response_code = 204 uri = /vpc-routes
23882025-03-21T18:47:08.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34470
23892025-03-21T18:47:08.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34470 req_id = 0b6ba191-7fe6-400c-b4a5-3bb49b35f4dd response_code = 200 uri = /vpc-routes
23902025-03-21T18:47:08.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47934
23912025-03-21T18:47:08.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47934 req_id = 43fee5af-28fd-495d-9b0a-5da546cd5751 response_code = 200 uri = /vpc-routes
23922025-03-21T18:47:08.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
23932025-03-21T18:47:08.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34470 req_id = 8d4888fa-10e2-4246-a96d-918095d201ca response_code = 204 uri = /eip-gateways
23942025-03-21T18:47:08.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43823
23952025-03-21T18:47:08.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23962025-03-21T18:47:08.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23972025-03-21T18:47:08.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43823 req_id = 80417271-75ba-42e5-acb6-b635ee3e0dd0 response_code = 204 uri = /switch-ports
23982025-03-21T18:47:08.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53036
23992025-03-21T18:47:08.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24002025-03-21T18:47:08.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47934 req_id = 5ee4b71e-ab1c-40a1-811c-e9ed738ef10b response_code = 204 uri = /eip-gateways
24012025-03-21T18:47:08.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53888
24022025-03-21T18:47:08.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63063
24032025-03-21T18:47:08.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59600
24042025-03-21T18:47:08.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53036 req_id = ec7811fd-80c3-431c-bd46-b63cc67092a9 response_code = 200 uri = /v2p
24052025-03-21T18:47:08.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43823 req_id = 5ed3cc8f-a6d4-4e9b-95e4-a36cc49be77c response_code = 200 uri = /network-bootstore-config
24062025-03-21T18:47:08.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24072025-03-21T18:47:08.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53888 req_id = 04c37f3f-c30e-42d1-9542-a502ad27a983 response_code = 200 uri = /v2p
24082025-03-21T18:47:08.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4762 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34470 req_id = de3f7576-07e8-4b05-9ae8-785c84ae02a4 response_code = 204 uri = /vpc-routes
24092025-03-21T18:47:08.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47934 req_id = 8c695aa9-72d7-41bf-923d-309d36988f7b response_code = 204 uri = /vpc-routes
24102025-03-21T18:47:08.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24112025-03-21T18:47:08.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33297
24122025-03-21T18:47:08.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33297 req_id = b766e39a-76b6-4630-a5d9-79ff29854790 response_code = 200 uri = /v2p
24132025-03-21T18:47:08.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59600 req_id = 1bfb73ab-7262-4959-ba82-27c47d6c91de response_code = 204 uri = /switch-ports
24142025-03-21T18:47:08.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24152025-03-21T18:47:08.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59600 req_id = 1c51666e-d096-4b73-878f-e390d78c4404 response_code = 200 uri = /network-bootstore-config
24162025-03-21T18:47:08.940ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24172025-03-21T18:47:08.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63063 req_id = ffacd9bf-f5b7-4684-8cff-2a6e153c8785 response_code = 204 uri = /switch-ports
24182025-03-21T18:47:08.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63063 req_id = 87696bf8-42ab-47cf-ad39-174f6801ce45 response_code = 200 uri = /network-bootstore-config
24192025-03-21T18:47:21.275ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
24202025-03-21T18:47:21.275ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
24212025-03-21T18:47:21.275ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
24222025-03-21T18:47:21.275ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
24232025-03-21T18:47:25.208ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50279
24242025-03-21T18:47:25.208ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50279 req_id = 03814f91-038b-4abc-8645-4d40e4a4c7d2 response_code = 200 uri = /baseboard
24252025-03-21T18:47:28.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 036e92a6-4524-4cdc-b4e5-84955155a2dd response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
24262025-03-21T18:47:38.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57970
24272025-03-21T18:47:38.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57970 req_id = 85da768c-195b-4a0c-965d-5effa84a6615 response_code = 200 uri = /vpc-routes
24282025-03-21T18:47:38.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34482
24292025-03-21T18:47:38.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34482 req_id = 672a8d04-eb41-4f47-8eb7-a2217e7fa1e8 response_code = 200 uri = /v2p
24302025-03-21T18:47:38.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24312025-03-21T18:47:38.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57970 req_id = 629471d5-ee46-4519-989a-bca17a9293c1 response_code = 204 uri = /eip-gateways
24322025-03-21T18:47:38.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57970 req_id = 4ca912b2-6e91-4e94-8b90-bb0e3c469ffb response_code = 204 uri = /vpc-routes
24332025-03-21T18:47:38.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45861
24342025-03-21T18:47:38.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45861 req_id = 74e87c15-c59a-4f0b-b2fe-ea32c8ab09e8 response_code = 200 uri = /vpc-routes
24352025-03-21T18:47:38.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53566
24362025-03-21T18:47:38.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53566 req_id = 6a9872d7-72d5-438e-a0d2-69796c2ea09f response_code = 200 uri = /v2p
24372025-03-21T18:47:38.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24382025-03-21T18:47:38.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45861 req_id = 6f59dbc3-6b49-45c7-95ac-ff1f0b7cba1f response_code = 204 uri = /eip-gateways
24392025-03-21T18:47:38.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45861 req_id = b0008f91-6293-4052-9722-e1f42197d5c4 response_code = 204 uri = /vpc-routes
24402025-03-21T18:47:38.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60588
24412025-03-21T18:47:38.905ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24422025-03-21T18:47:38.949ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24432025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60588 req_id = 60ff10ea-e0c8-4c0e-bc0d-6b0f1f8d6c55 response_code = 204 uri = /switch-ports
24442025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47459
24452025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38703
24462025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38703 req_id = 68dcbdfa-4f8a-43e6-bfc3-268040250977 response_code = 200 uri = /vpc-routes
24472025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60588 req_id = 585310ac-2107-45d0-9f7e-e1f6fcaa28a4 response_code = 200 uri = /network-bootstore-config
24482025-03-21T18:47:39.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47459 req_id = 259815a7-834c-4f10-95f3-af8b608175a3 response_code = 200 uri = /v2p
24492025-03-21T18:47:39.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24502025-03-21T18:47:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38703 req_id = 0ac70c5f-2fbe-4ad5-b3d8-a9d007d25858 response_code = 204 uri = /eip-gateways
24512025-03-21T18:47:39.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50974
24522025-03-21T18:47:39.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24532025-03-21T18:47:39.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24542025-03-21T18:47:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50974 req_id = edc7abfd-3127-4a2f-b712-2d0042d83b0b response_code = 204 uri = /switch-ports
24552025-03-21T18:47:39.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60394
24562025-03-21T18:47:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50974 req_id = bb6db92e-311a-44ca-956f-703021be9ee8 response_code = 200 uri = /network-bootstore-config
24572025-03-21T18:47:39.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24582025-03-21T18:47:39.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38703 req_id = d254b6bf-6d01-48e6-a9f2-7c7698889a16 response_code = 204 uri = /vpc-routes
24592025-03-21T18:47:39.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24602025-03-21T18:47:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60394 req_id = 5d3c9647-66e4-472b-a19e-26fef31d4792 response_code = 204 uri = /switch-ports
24612025-03-21T18:47:39.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60394 req_id = 6d4dd6bc-4486-4cdd-ab6c-831daa2af753 response_code = 200 uri = /network-bootstore-config
24622025-03-21T18:47:55.241ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45948
24632025-03-21T18:47:55.241ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45948 req_id = 375eccbf-b462-4108-8e8d-824a07a391c3 response_code = 200 uri = /baseboard
24642025-03-21T18:47:58.419ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7626 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = dec3dca2-ebec-4679-acc3-c8d9d797dbf0 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
24652025-03-21T18:48:08.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35515
24662025-03-21T18:48:08.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35515 req_id = 5d212289-dc03-4888-8693-a6b7c3fb03b2 response_code = 200 uri = /vpc-routes
24672025-03-21T18:48:08.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54897
24682025-03-21T18:48:08.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54897 req_id = bb37abe5-b0a6-4db1-8d11-bcb7cd020c16 response_code = 200 uri = /vpc-routes
24692025-03-21T18:48:08.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42297
24702025-03-21T18:48:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42297 req_id = 6fd27313-ba61-46d3-a882-c392526d467a response_code = 200 uri = /v2p
24712025-03-21T18:48:08.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64089
24722025-03-21T18:48:08.636ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24732025-03-21T18:48:08.677ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24742025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64089 req_id = fcb370d0-3524-498d-8cd3-5db881af980d response_code = 204 uri = /switch-ports
24752025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46241
24762025-03-21T18:48:08.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24772025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47496
24782025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54897 req_id = a53c3a9d-8b4d-40bc-9ca0-5e46f8dd3238 response_code = 204 uri = /eip-gateways
24792025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55189
24802025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48705
24812025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46241 req_id = 98e57f4f-7c4b-4233-be85-0301402bbc24 response_code = 200 uri = /vpc-routes
24822025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64089 req_id = 5c068d51-4c7a-45fd-86b2-dfb78dd9d60a response_code = 200 uri = /network-bootstore-config
24832025-03-21T18:48:08.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24842025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35515 req_id = 6225d6eb-0bd7-466e-8cc5-850592a8f261 response_code = 204 uri = /eip-gateways
24852025-03-21T18:48:08.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24862025-03-21T18:48:08.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47496 req_id = 5d0eda03-1470-4ba8-9942-ac51cb8de60f response_code = 200 uri = /v2p
24872025-03-21T18:48:08.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48705 req_id = db72676d-c281-4cf2-9233-b1cce85697ae response_code = 200 uri = /v2p
24882025-03-21T18:48:08.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 450 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54897 req_id = c31e905b-c667-4065-8d13-db8aff209684 response_code = 204 uri = /vpc-routes
24892025-03-21T18:48:08.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35515 req_id = 2db12fc0-44a1-4b9b-9b9b-bb3cc42b2fe3 response_code = 204 uri = /vpc-routes
24902025-03-21T18:48:08.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
24912025-03-21T18:48:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46241 req_id = 5a5a88b4-e277-4feb-b3c5-0e9276fc4f9d response_code = 204 uri = /eip-gateways
24922025-03-21T18:48:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 966 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46241 req_id = 4a248613-c719-4d00-99fe-1cfad707ef97 response_code = 204 uri = /vpc-routes
24932025-03-21T18:48:08.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24942025-03-21T18:48:08.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33648
24952025-03-21T18:48:08.839ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24962025-03-21T18:48:08.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55189 req_id = d1b3c05d-ca17-4963-aa02-268bddbc90c7 response_code = 204 uri = /switch-ports
24972025-03-21T18:48:08.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55189 req_id = 672b2de2-6e33-4f23-bbd8-93863ac2b14d response_code = 200 uri = /network-bootstore-config
24982025-03-21T18:48:08.877ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24992025-03-21T18:48:08.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33648 req_id = 4a983848-0c69-4b6b-aba8-b7b4038129e4 response_code = 204 uri = /switch-ports
25002025-03-21T18:48:08.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33648 req_id = 75f15560-8b32-425a-9f88-be3777ef2b43 response_code = 200 uri = /network-bootstore-config
25012025-03-21T18:48:21.275ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
25022025-03-21T18:48:21.276ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
25032025-03-21T18:48:21.276ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
25042025-03-21T18:48:21.276ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
25052025-03-21T18:48:22.614ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25062025-03-21T18:48:22.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25072025-03-21T18:48:22.643ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1967, tv_nsec: 513551317 } time_to_next_cleanup = 599.999995989s
25082025-03-21T18:48:25.274ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36192
25092025-03-21T18:48:25.275ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36192 req_id = 304c2541-afd0-4628-b0c9-c496f35a1cbb response_code = 200 uri = /baseboard
25102025-03-21T18:48:28.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9107 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 9355ed64-0883-4a1f-bae9-52f302a057c6 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
25112025-03-21T18:48:37.287ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
25122025-03-21T18:48:38.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54309
25132025-03-21T18:48:38.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54309 req_id = 56c3cf81-f3e1-4286-a792-e63928cc08fb response_code = 200 uri = /vpc-routes
25142025-03-21T18:48:38.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25152025-03-21T18:48:38.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54309 req_id = b418c21b-7efe-4d82-9eae-ccc420397b14 response_code = 204 uri = /eip-gateways
25162025-03-21T18:48:38.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54309 req_id = 56fcf9cf-d2d6-4c5c-bc97-8c9fdf3a4c6a response_code = 204 uri = /vpc-routes
25172025-03-21T18:48:38.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55170
25182025-03-21T18:48:38.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55170 req_id = cb170a86-29b6-46e3-ba56-809103011eb4 response_code = 200 uri = /vpc-routes
25192025-03-21T18:48:38.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41493
25202025-03-21T18:48:38.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41493 req_id = 61d09185-26ac-4bdd-894e-f02c388d3a3f response_code = 200 uri = /vpc-routes
25212025-03-21T18:48:38.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25222025-03-21T18:48:38.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41493 req_id = eef5e71a-36b3-4a80-85ac-9483889cbcb9 response_code = 204 uri = /eip-gateways
25232025-03-21T18:48:38.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41493 req_id = 1819d354-3026-4b83-ae31-ac9f6253b52e response_code = 204 uri = /vpc-routes
25242025-03-21T18:48:38.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43320
25252025-03-21T18:48:38.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 428ebe72-889f-4597-9e37-635d0a7e55f2 response_code = 200 uri = /v2p
25262025-03-21T18:48:38.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25272025-03-21T18:48:38.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55170 req_id = 45bc8ee0-0754-45ce-a3a9-8547511e14da response_code = 204 uri = /eip-gateways
25282025-03-21T18:48:38.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55170 req_id = 735c18d2-59a2-4378-b9e3-e8d93381ff3c response_code = 204 uri = /vpc-routes
25292025-03-21T18:48:38.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51872
25302025-03-21T18:48:38.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51872 req_id = 754d3848-5317-48d1-be98-01d695dda6af response_code = 200 uri = /v2p
25312025-03-21T18:48:38.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59943
25322025-03-21T18:48:38.901ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25332025-03-21T18:48:38.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25342025-03-21T18:48:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131733 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59943 req_id = 60e8304f-0a2d-4e2d-aea3-77ab6220429d response_code = 204 uri = /switch-ports
25352025-03-21T18:48:39.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46992
25362025-03-21T18:48:39.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44977
25372025-03-21T18:48:39.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46395
25382025-03-21T18:48:39.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25392025-03-21T18:48:39.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46992 req_id = 7f41726f-e7d4-460b-b377-3c09b29a0196 response_code = 200 uri = /v2p
25402025-03-21T18:48:39.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3966 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59943 req_id = 244a8d7d-d0fd-456e-ba7e-b37d06efd948 response_code = 200 uri = /network-bootstore-config
25412025-03-21T18:48:39.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25422025-03-21T18:48:39.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25432025-03-21T18:48:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46395 req_id = 717fa095-f166-45aa-9d49-b7970a47288f response_code = 204 uri = /switch-ports
25442025-03-21T18:48:39.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46395 req_id = 9fd4d94e-347c-4841-8a6d-d9553c7deb2c response_code = 200 uri = /network-bootstore-config
25452025-03-21T18:48:39.173ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25462025-03-21T18:48:39.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44977 req_id = d714080a-2a7b-496b-8d2d-e559413ad7eb response_code = 204 uri = /switch-ports
25472025-03-21T18:48:39.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44977 req_id = 290406ec-115d-4ecd-8145-d2fd62e80d9d response_code = 200 uri = /network-bootstore-config
25482025-03-21T18:48:55.306ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50080
25492025-03-21T18:48:55.306ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50080 req_id = 62612ace-a030-4b57-bcb2-f33b703a7f52 response_code = 200 uri = /baseboard
25502025-03-21T18:48:58.420ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7945 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 901b3862-da38-4687-b3d5-61b197baa1a7 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
25512025-03-21T18:49:08.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59706
25522025-03-21T18:49:08.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59706 req_id = 7ef3e225-dc02-40f9-a97d-4ccfe83c5b51 response_code = 200 uri = /vpc-routes
25532025-03-21T18:49:08.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39190
25542025-03-21T18:49:08.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39190 req_id = 7411017b-a7ac-4777-84ae-279985abe75c response_code = 200 uri = /vpc-routes
25552025-03-21T18:49:08.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25562025-03-21T18:49:08.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39190 req_id = bf373222-40fa-4b56-ac5e-024759e0ff44 response_code = 204 uri = /eip-gateways
25572025-03-21T18:49:08.618ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25582025-03-21T18:49:08.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59706 req_id = 396da64a-47f8-40b7-af41-a559118f118a response_code = 204 uri = /eip-gateways
25592025-03-21T18:49:08.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36822
25602025-03-21T18:49:08.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36822 req_id = 6500305c-6bf9-4285-89de-422746c31d65 response_code = 200 uri = /v2p
25612025-03-21T18:49:08.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39190 req_id = e10104e8-32de-4e6e-ac71-27ffcab74db6 response_code = 204 uri = /vpc-routes
25622025-03-21T18:49:08.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41787
25632025-03-21T18:49:08.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41787 req_id = ca31d89f-5731-49e7-b628-7a46f1a7583a response_code = 200 uri = /vpc-routes
25642025-03-21T18:49:08.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58799
25652025-03-21T18:49:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58799 req_id = be6e2d54-cbde-4adf-801f-a16a65efb0eb response_code = 200 uri = /v2p
25662025-03-21T18:49:08.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
25672025-03-21T18:49:08.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41787 req_id = 5ff34d60-9990-4d2a-95d9-80f80d044abf response_code = 204 uri = /eip-gateways
25682025-03-21T18:49:08.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59706 req_id = 7bc87eed-2983-476d-9f9a-2bdeec62d6a6 response_code = 204 uri = /vpc-routes
25692025-03-21T18:49:08.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41787 req_id = d102c8de-52e1-47cd-bd95-9888848f6069 response_code = 204 uri = /vpc-routes
25702025-03-21T18:49:08.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56964
25712025-03-21T18:49:08.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25722025-03-21T18:49:08.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25732025-03-21T18:49:08.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56964 req_id = adaf6950-6619-4fff-972b-c410730d3323 response_code = 204 uri = /switch-ports
25742025-03-21T18:49:08.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34815
25752025-03-21T18:49:08.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50174
25762025-03-21T18:49:08.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44808
25772025-03-21T18:49:08.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25782025-03-21T18:49:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56964 req_id = 2434d06c-ff5d-41fe-a906-14a4ad911626 response_code = 200 uri = /network-bootstore-config
25792025-03-21T18:49:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34815 req_id = c2d0ec9b-1ec7-4de3-a52d-de0691b69cc1 response_code = 200 uri = /v2p
25802025-03-21T18:49:08.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25812025-03-21T18:49:08.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25822025-03-21T18:49:08.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44808 req_id = 4235ffeb-2370-4712-999b-5b9c697df721 response_code = 204 uri = /switch-ports
25832025-03-21T18:49:08.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44808 req_id = e7cf8b1a-2410-4b7e-a835-7fb75f50c2af response_code = 200 uri = /network-bootstore-config
25842025-03-21T18:49:08.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25852025-03-21T18:49:08.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181296 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50174 req_id = fb2f545b-922b-41b7-b16d-9f27d71d4337 response_code = 204 uri = /switch-ports
25862025-03-21T18:49:08.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50174 req_id = 1f86bbf4-7fde-4990-93aa-20fbee2dbf61 response_code = 200 uri = /network-bootstore-config
25872025-03-21T18:49:21.276ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
25882025-03-21T18:49:21.276ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
25892025-03-21T18:49:21.276ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
25902025-03-21T18:49:21.276ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
25912025-03-21T18:49:25.341ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49393
25922025-03-21T18:49:25.341ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49393 req_id = 06284302-99cb-4b75-84cd-a562cbabce24 response_code = 200 uri = /baseboard
25932025-03-21T18:49:28.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8236 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = b0a5381d-2969-4c00-8c87-1f6fedd1193d response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
25942025-03-21T18:49:38.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53939
25952025-03-21T18:49:38.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53939 req_id = 134dc7b4-04a2-431c-85f3-91920ecdabab response_code = 200 uri = /vpc-routes
25962025-03-21T18:49:38.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34473
25972025-03-21T18:49:38.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34473 req_id = 295aa3c4-f544-4446-aee1-a9d7db965a13 response_code = 200 uri = /vpc-routes
25982025-03-21T18:49:38.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58046
25992025-03-21T18:49:38.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58046 req_id = eecebbcd-9658-4952-9470-4faa99019dd9 response_code = 200 uri = /vpc-routes
26002025-03-21T18:49:38.791ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26012025-03-21T18:49:38.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53939 req_id = 8120f46e-1499-49aa-90c1-c4ee500d0464 response_code = 204 uri = /eip-gateways
26022025-03-21T18:49:38.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26032025-03-21T18:49:38.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34473 req_id = d3ab8526-7321-4bde-8df2-94a01dd1b596 response_code = 204 uri = /eip-gateways
26042025-03-21T18:49:38.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53939 req_id = e7cdd07f-491a-4dd6-b2c4-a76e749a2e98 response_code = 204 uri = /vpc-routes
26052025-03-21T18:49:38.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34473 req_id = 25b8e206-b0f5-415f-b22d-4bae60cd6c63 response_code = 204 uri = /vpc-routes
26062025-03-21T18:49:38.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26072025-03-21T18:49:38.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58046 req_id = a2f00633-02bc-49d7-8b1f-50d269525c9f response_code = 204 uri = /eip-gateways
26082025-03-21T18:49:38.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52849
26092025-03-21T18:49:38.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26102025-03-21T18:49:38.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26112025-03-21T18:49:38.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52849 req_id = 5a73d22b-1869-4c17-8cdf-3f595aa87e3d response_code = 204 uri = /switch-ports
26122025-03-21T18:49:38.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54213
26132025-03-21T18:49:38.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58453
26142025-03-21T18:49:38.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33736
26152025-03-21T18:49:38.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26162025-03-21T18:49:38.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52849 req_id = 63e1f958-f6dd-40b8-b6e6-5c436a30be0a response_code = 200 uri = /network-bootstore-config
26172025-03-21T18:49:38.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58453 req_id = ad267876-c3ae-4652-945e-67667fbae06f response_code = 200 uri = /v2p
26182025-03-21T18:49:38.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54213 req_id = 7615424a-a667-4c5e-9f9a-31b88e3e8036 response_code = 200 uri = /v2p
26192025-03-21T18:49:38.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58046 req_id = be127251-3edd-43c9-a342-4425004e22dd response_code = 204 uri = /vpc-routes
26202025-03-21T18:49:39.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58613
26212025-03-21T18:49:39.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58613 req_id = ced9d41a-759f-4462-a4bd-0f65174f2de2 response_code = 200 uri = /v2p
26222025-03-21T18:49:39.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26232025-03-21T18:49:39.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50316
26242025-03-21T18:49:39.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26252025-03-21T18:49:39.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33736 req_id = 9d333fbb-0ca0-473c-b98c-4e8dcbf7cf51 response_code = 204 uri = /switch-ports
26262025-03-21T18:49:39.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33736 req_id = d8b32625-9f24-42bf-b7a3-3870853d5214 response_code = 200 uri = /network-bootstore-config
26272025-03-21T18:49:39.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26282025-03-21T18:49:39.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147927 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50316 req_id = 38535c4e-a4e7-4f41-98d9-03b29b576580 response_code = 204 uri = /switch-ports
26292025-03-21T18:49:39.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50316 req_id = dbc3b577-e95d-4827-9612-b178d19c60d1 response_code = 200 uri = /network-bootstore-config
26302025-03-21T18:49:55.374ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59642
26312025-03-21T18:49:55.374ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59642 req_id = c6c9965d-d626-4a48-8289-58390ec9e532 response_code = 200 uri = /baseboard
26322025-03-21T18:49:58.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8069 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = e079eaae-dba9-4da0-af63-5f1056243e65 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
26332025-03-21T18:50:08.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53383
26342025-03-21T18:50:08.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53383 req_id = 281fc968-7981-4da6-9a35-e8de6d898d2b response_code = 200 uri = /vpc-routes
26352025-03-21T18:50:08.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38371
26362025-03-21T18:50:08.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38371 req_id = a2728b9a-b877-4a95-95a3-6005fcef7fdb response_code = 200 uri = /vpc-routes
26372025-03-21T18:50:08.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26382025-03-21T18:50:08.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53383 req_id = 232687be-605a-4489-9056-47faffcfc9b0 response_code = 204 uri = /eip-gateways
26392025-03-21T18:50:08.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44766
26402025-03-21T18:50:08.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44766 req_id = b748102f-ade0-48bc-90a1-28021fcb8461 response_code = 200 uri = /vpc-routes
26412025-03-21T18:50:08.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53383 req_id = 3ee862ac-1008-4e64-87aa-dd1c6fa5a410 response_code = 204 uri = /vpc-routes
26422025-03-21T18:50:08.695ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26432025-03-21T18:50:08.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38371 req_id = bcb4b5b4-0829-4990-89de-cf4456527b1f response_code = 204 uri = /eip-gateways
26442025-03-21T18:50:08.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26452025-03-21T18:50:08.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44766 req_id = 1bfe6adb-6ae4-451e-9b2d-434495d45fca response_code = 204 uri = /eip-gateways
26462025-03-21T18:50:08.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38371 req_id = de3e0b0e-8488-4620-8903-d916dd6e6590 response_code = 204 uri = /vpc-routes
26472025-03-21T18:50:08.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44766 req_id = cc97943b-1a48-499d-9981-fe4990729980 response_code = 204 uri = /vpc-routes
26482025-03-21T18:50:08.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44374
26492025-03-21T18:50:08.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44374 req_id = 8e8aa35f-1223-41a3-9716-0fca3189901a response_code = 200 uri = /v2p
26502025-03-21T18:50:08.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44099
26512025-03-21T18:50:08.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26522025-03-21T18:50:08.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26532025-03-21T18:50:08.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44099 req_id = 70a1b753-4181-424b-83fe-efdf9233d2ce response_code = 204 uri = /switch-ports
26542025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36513
26552025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48839
26562025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47870
26572025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37593
26582025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44099 req_id = f45b30f8-fa71-452e-bd2b-e891be17360d response_code = 200 uri = /network-bootstore-config
26592025-03-21T18:50:08.906ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26602025-03-21T18:50:08.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48839 req_id = 86f58b9d-4929-4c58-a2c6-cda05855e537 response_code = 200 uri = /v2p
26612025-03-21T18:50:08.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47870 req_id = 8956ea45-3392-4a71-8c66-7ef91f58bba3 response_code = 200 uri = /v2p
26622025-03-21T18:50:08.945ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26632025-03-21T18:50:09.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26642025-03-21T18:50:09.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37593 req_id = a8d9af16-1a2a-43f4-8a0d-fd8de697fdb5 response_code = 204 uri = /switch-ports
26652025-03-21T18:50:09.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37593 req_id = 31e9be53-ae17-49b0-924f-eaf8ec37c3f9 response_code = 200 uri = /network-bootstore-config
26662025-03-21T18:50:09.039ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26672025-03-21T18:50:09.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36513 req_id = 9f56b905-7363-4355-bc61-3f532d6ce6fb response_code = 204 uri = /switch-ports
26682025-03-21T18:50:09.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36513 req_id = e0253956-b7b0-4c66-97cb-8178c5e075c4 response_code = 200 uri = /network-bootstore-config
26692025-03-21T18:50:21.276ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
26702025-03-21T18:50:21.277ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
26712025-03-21T18:50:21.277ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
26722025-03-21T18:50:21.277ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
26732025-03-21T18:50:25.409ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39880
26742025-03-21T18:50:25.409ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39880 req_id = 4c1ae098-6f01-46a7-8eec-91765f5cade4 response_code = 200 uri = /baseboard
26752025-03-21T18:50:28.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8953 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 7ee2b5d0-e90a-472e-932b-5453d3e42239 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
26762025-03-21T18:50:38.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64842
26772025-03-21T18:50:38.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64842 req_id = 6325cb80-8308-4073-a6ab-e9d37ccac755 response_code = 200 uri = /vpc-routes
26782025-03-21T18:50:38.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39279
26792025-03-21T18:50:38.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26802025-03-21T18:50:38.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39279 req_id = 408719f5-de82-4b38-a964-941d43f37337 response_code = 200 uri = /artifacts
26812025-03-21T18:50:38.838ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26822025-03-21T18:50:38.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64842 req_id = e1e7a86b-9b38-4f95-8e36-de3b1551e126 response_code = 204 uri = /eip-gateways
26832025-03-21T18:50:38.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63122
26842025-03-21T18:50:38.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63122 req_id = b0a322d4-4dae-4883-a572-a74660c8a09c response_code = 200 uri = /vpc-routes
26852025-03-21T18:50:39.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33070
26862025-03-21T18:50:39.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33070 req_id = 55c8e069-1ee0-4035-a8fe-53930c6a9813 response_code = 200 uri = /v2p
26872025-03-21T18:50:39.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64548
26882025-03-21T18:50:39.023ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26892025-03-21T18:50:39.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64548 req_id = f99d1050-0d89-46be-9f24-7eb307b3eb1d response_code = 200 uri = /artifacts
26902025-03-21T18:50:39.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64413
26912025-03-21T18:50:39.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64413 req_id = 47b343e7-5a28-4f8e-8dfc-a56f289a56d2 response_code = 200 uri = /vpc-routes
26922025-03-21T18:50:39.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53861
26932025-03-21T18:50:39.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26942025-03-21T18:50:39.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53861 req_id = 3ded9556-9891-472a-b003-5e6612f8f556 response_code = 200 uri = /artifacts
26952025-03-21T18:50:39.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26962025-03-21T18:50:39.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63122 req_id = 178a860d-6429-4562-adf9-045e520284b1 response_code = 204 uri = /eip-gateways
26972025-03-21T18:50:39.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
26982025-03-21T18:50:39.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64413 req_id = 4ed5b848-78dc-4244-bb70-b9d05aa65d81 response_code = 204 uri = /eip-gateways
26992025-03-21T18:50:39.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52441
27002025-03-21T18:50:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52441 req_id = 410a3c80-6eff-4e30-832e-a0d74f15bc08 response_code = 200 uri = /v2p
27012025-03-21T18:50:39.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63122 req_id = d28800a5-2c38-4db9-8e1a-af6a9e4581f8 response_code = 204 uri = /vpc-routes
27022025-03-21T18:50:39.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64842 req_id = 91a2a817-cb96-47b8-b1f3-e17895823ea2 response_code = 204 uri = /vpc-routes
27032025-03-21T18:50:39.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42627
27042025-03-21T18:50:39.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27052025-03-21T18:50:39.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27062025-03-21T18:50:39.111ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
27072025-03-21T18:50:39.111ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
27082025-03-21T18:50:39.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56660
27092025-03-21T18:50:39.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45225
27102025-03-21T18:50:39.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27112025-03-21T18:50:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5949 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45225 req_id = 4dafd8d3-acd0-406e-a1cf-6744f83cf545 response_code = 200 uri = /v2p
27122025-03-21T18:50:39.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132025-03-21T18:50:39.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_2219f396-1299-4176-91e7-626a9f13bedc
27142025-03-21T18:50:39.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-03-21T18:50:39.158ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe
27162025-03-21T18:50:39.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27172025-03-21T18:50:39.185ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27182025-03-21T18:50:39.185ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_93f27406-584f-49b0-bbdf-aec064c7573f
27192025-03-21T18:50:39.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-03-21T18:50:39.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_47056192-ed60-41f0-aecf-23ae41e9cb50
27212025-03-21T18:50:39.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56660 req_id = f373a23f-07f3-423b-bad4-eb97d39eea17 response_code = 204 uri = /switch-ports
27222025-03-21T18:50:39.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56660 req_id = 1deb211e-30ee-4f11-8506-fd285bb6c7b5 response_code = 200 uri = /network-bootstore-config
27232025-03-21T18:50:39.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35115
27242025-03-21T18:50:39.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27252025-03-21T18:50:39.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27262025-03-21T18:50:39.241ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
27272025-03-21T18:50:39.241ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
27282025-03-21T18:50:39.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 763 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64413 req_id = e11464af-12d0-4e5c-819b-59f844e5c164 response_code = 204 uri = /vpc-routes
27292025-03-21T18:50:39.247ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302025-03-21T18:50:39.247ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb
27312025-03-21T18:50:39.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40948
27322025-03-21T18:50:39.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50217
27332025-03-21T18:50:39.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27342025-03-21T18:50:39.260ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27352025-03-21T18:50:39.264ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27362025-03-21T18:50:39.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27372025-03-21T18:50:39.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27382025-03-21T18:50:39.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27392025-03-21T18:50:39.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27402025-03-21T18:50:39.265ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412025-03-21T18:50:39.265ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_2219f396-1299-4176-91e7-626a9f13bedc
27422025-03-21T18:50:39.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27432025-03-21T18:50:39.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10741 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40948 req_id = 4afd9194-bb93-4b71-8de9-ea11c057ce6a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27442025-03-21T18:50:39.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41973
27452025-03-21T18:50:39.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27462025-03-21T18:50:39.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27472025-03-21T18:50:39.281ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/config/omicron-zones.json file = common/src/ledger.rs:175
27482025-03-21T18:50:39.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27492025-03-21T18:50:39.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba
27502025-03-21T18:50:39.296ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/config/omicron-zones.json file = common/src/ledger.rs:175
27512025-03-21T18:50:39.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47930
27522025-03-21T18:50:39.307ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27532025-03-21T18:50:39.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27542025-03-21T18:50:39.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe
27552025-03-21T18:50:39.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2219f396-1299-4176-91e7-626a9f13bedc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27562025-03-21T18:50:39.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_2219f396-1299-4176-91e7-626a9f13bedc
27572025-03-21T18:50:39.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27582025-03-21T18:50:39.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9
27592025-03-21T18:50:39.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27602025-03-21T18:50:39.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_93f27406-584f-49b0-bbdf-aec064c7573f
27612025-03-21T18:50:39.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40425
27622025-03-21T18:50:39.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27632025-03-21T18:50:39.391ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27642025-03-21T18:50:39.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe
27652025-03-21T18:50:39.392ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27662025-03-21T18:50:39.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39454
27672025-03-21T18:50:39.397ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27682025-03-21T18:50:39.397ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27692025-03-21T18:50:39.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27702025-03-21T18:50:39.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27712025-03-21T18:50:39.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27722025-03-21T18:50:39.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27732025-03-21T18:50:39.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50217 req_id = c95697ad-8171-463f-a319-53e4465bb21d response_code = 204 uri = /switch-ports
27742025-03-21T18:50:39.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40425 req_id = 53d148e6-9e53-4d67-a397-4c10639240a7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27752025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 769f5143-cf6f-4528-9382-0122c9a2acbe, kind: Service { id: 5d94b88f-d605-40ae-bdec-b8303d159330 }, name: Name("external-dns-5d94b88f-d605-40ae-bdec-b8303d159330"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 154])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fafea2a0-2c6b-4591-bf02-46f0ff173011, kind: Service { id: 143937aa-1662-4be7-b315-db1f929987b0 }, name: Name("external-dns-143937aa-1662-4be7-b315-db1f929987b0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4953a293-3ee9-4fcf-b9b0-ddb5318c1181, kind: Service { id: c36ec202-8c35-4d6a-b1b3-9bac844d8fbf }, name: Name("nexus-c36ec202-8c35-4d6a-b1b3-9bac844d8fbf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 73])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 63bde31c-e372-44fa-bf00-bf3a30df21ed, kind: Service { id: f1d166da-3cb7-4a30-8a48-52436a59fe29 }, name: Name("nexus-f1d166da-3cb7-4a30-8a48-52436a59fe29"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 50])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6bad6448-f01d-4d73-bacf-f12ad1db0aba, kind: Service { id: 02fc0a56-1448-4d70-95c0-f34330562c4b }, name: Name("nexus-02fc0a56-1448-4d70-95c0-f34330562c4b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27762025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27772025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27782025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27792025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27802025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27812025-03-21T18:50:39.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50217 req_id = 2d9cf0e0-93b8-4135-8d60-49ca40d4a54b response_code = 200 uri = /network-bootstore-config
27822025-03-21T18:50:39.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27832025-03-21T18:50:39.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39454 req_id = 3ad68654-8244-4fd3-9584-ad367b99a82b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27842025-03-21T18:50:39.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27852025-03-21T18:50:39.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_47056192-ed60-41f0-aecf-23ae41e9cb50
27862025-03-21T18:50:39.433ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-03-21T18:50:39.433ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_71dc428d-9d1f-483c-b923-af3efe9583af
27882025-03-21T18:50:39.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27892025-03-21T18:50:39.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93f27406-584f-49b0-bbdf-aec064c7573f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27902025-03-21T18:50:39.457ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_93f27406-584f-49b0-bbdf-aec064c7573f
27912025-03-21T18:50:39.477ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27922025-03-21T18:50:39.478ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb
27932025-03-21T18:50:39.493ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 47056192-ed60-41f0-aecf-23ae41e9cb50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27942025-03-21T18:50:39.493ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_47056192-ed60-41f0-aecf-23ae41e9cb50
27952025-03-21T18:50:39.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27962025-03-21T18:50:39.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_746ded48-1093-4fb4-a064-8507518ef38c
27972025-03-21T18:50:39.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47930 req_id = 1a2f2c56-30a6-4b8e-bdf3-2ef20763c9a9 response_code = 204 uri = /switch-ports
27982025-03-21T18:50:39.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47930 req_id = 9a57cd87-ed6f-409d-bd92-fddd50621f5c response_code = 200 uri = /network-bootstore-config
27992025-03-21T18:50:39.525ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28002025-03-21T18:50:39.525ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba
28012025-03-21T18:50:39.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 421327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42627 req_id = 364303a4-86c1-4a72-81d4-86e43e580552 response_code = 200 uri = /inventory
28022025-03-21T18:50:39.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5519ee6b-7309-4026-8ae2-5d5e1df07ffb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28032025-03-21T18:50:39.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5519ee6b-7309-4026-8ae2-5d5e1df07ffb
28042025-03-21T18:50:39.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3e248cb-26a3-4cbb-84d7-39726ac275ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28052025-03-21T18:50:39.563ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_b3e248cb-26a3-4cbb-84d7-39726ac275ba
28062025-03-21T18:50:39.576ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28072025-03-21T18:50:39.576ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9
28082025-03-21T18:50:39.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 062d3677-bd7e-4b38-a486-3ce5e79fd3a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28092025-03-21T18:50:39.595ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_062d3677-bd7e-4b38-a486-3ce5e79fd3a9
28102025-03-21T18:50:39.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28112025-03-21T18:50:39.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_71dc428d-9d1f-483c-b923-af3efe9583af
28122025-03-21T18:50:39.638ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28132025-03-21T18:50:39.638ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_746ded48-1093-4fb4-a064-8507518ef38c
28142025-03-21T18:50:39.653ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71dc428d-9d1f-483c-b923-af3efe9583af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28152025-03-21T18:50:39.653ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_71dc428d-9d1f-483c-b923-af3efe9583af
28162025-03-21T18:50:39.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 417071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35115 req_id = 89d8d2c2-86e9-40dc-b386-e92114ebe976 response_code = 200 uri = /inventory
28172025-03-21T18:50:39.679ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 746ded48-1093-4fb4-a064-8507518ef38c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28182025-03-21T18:50:39.679ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_746ded48-1093-4fb4-a064-8507518ef38c
28192025-03-21T18:50:39.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 413945 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41973 req_id = db03adb5-7312-44a2-8a01-ad0b10f684a7 response_code = 200 uri = /inventory
28202025-03-21T18:50:55.442ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45056
28212025-03-21T18:50:55.442ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45056 req_id = cf6af283-0270-4b3a-857f-89752ccfebc5 response_code = 200 uri = /baseboard
28222025-03-21T18:50:58.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7769 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = 31e9822a-e3bb-4f99-99a9-439a8002f045 response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
28232025-03-21T18:51:08.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51071
28242025-03-21T18:51:08.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 01c20cbb-942d-44d5-b8f1-6cc7cc50216f response_code = 200 uri = /vpc-routes
28252025-03-21T18:51:08.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53347
28262025-03-21T18:51:08.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53347 req_id = a9a768ca-3a25-4a26-b0fc-b399d5512725 response_code = 200 uri = /vpc-routes
28272025-03-21T18:51:08.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
28282025-03-21T18:51:08.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 7c591b87-611f-4981-a3e3-ec544554fe49 response_code = 204 uri = /eip-gateways
28292025-03-21T18:51:08.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60890
28302025-03-21T18:51:08.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28312025-03-21T18:51:08.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28322025-03-21T18:51:08.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60890 req_id = c8d51659-6acf-4331-bcfc-f32d63e2476e response_code = 204 uri = /switch-ports
28332025-03-21T18:51:08.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40672
28342025-03-21T18:51:08.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39862
28352025-03-21T18:51:08.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
28362025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53347 req_id = f1022d94-a2d4-45df-8327-aeea51a9cded response_code = 204 uri = /eip-gateways
28372025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48512
28382025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60890 req_id = a032b75a-d2f6-43c0-8202-cb4796517ff2 response_code = 200 uri = /network-bootstore-config
28392025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60201
28402025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 75577675-66ba-42ef-80a1-0a5a2e3b86d2 response_code = 204 uri = /vpc-routes
28412025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60201 req_id = 91b697e5-7e60-4962-8545-c6de93cb736f response_code = 200 uri = /vpc-routes
28422025-03-21T18:51:08.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28432025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39862 req_id = 902c9805-9f15-4ef9-bddd-7a337650580f response_code = 200 uri = /v2p
28442025-03-21T18:51:08.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40672 req_id = 5855db3b-584c-4a92-850d-28787861221d response_code = 200 uri = /v2p
28452025-03-21T18:51:08.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53347 req_id = a1cf7255-66c5-45d2-9a3f-132df40fbaed response_code = 204 uri = /vpc-routes
28462025-03-21T18:51:08.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
28472025-03-21T18:51:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60201 req_id = 51095200-4b48-4a66-bedb-72741e8aa298 response_code = 204 uri = /eip-gateways
28482025-03-21T18:51:08.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28492025-03-21T18:51:08.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60201 req_id = e57848a4-3b17-4556-8ee4-df77e20b6f5c response_code = 204 uri = /vpc-routes
28502025-03-21T18:51:08.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45256
28512025-03-21T18:51:08.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28522025-03-21T18:51:08.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48512 req_id = 9b2dcc79-550c-42f8-a669-db7fa872430e response_code = 204 uri = /switch-ports
28532025-03-21T18:51:08.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48512 req_id = 6acece5f-fe6e-4c39-9515-02bb274a0e59 response_code = 200 uri = /network-bootstore-config
28542025-03-21T18:51:08.871ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28552025-03-21T18:51:08.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42426
28562025-03-21T18:51:08.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42426 req_id = b32575e9-f9a7-4dbf-ab6c-9489cd5e3100 response_code = 200 uri = /v2p
28572025-03-21T18:51:08.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45256 req_id = f50fd3ee-d8de-41d4-9a57-2bd44a2eff2e response_code = 204 uri = /switch-ports
28582025-03-21T18:51:08.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45256 req_id = da88bd4a-2adb-40f6-8ad6-ae67adedff82 response_code = 200 uri = /network-bootstore-config
28592025-03-21T18:51:21.277ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
28602025-03-21T18:51:21.278ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
28612025-03-21T18:51:21.278ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
28622025-03-21T18:51:21.278ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
28632025-03-21T18:51:25.475ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63092
28642025-03-21T18:51:25.475ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63092 req_id = fbbfd017-abd5-4bc9-afdc-5ea06219f0ff response_code = 200 uri = /baseboard
28652025-03-21T18:51:28.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8159 local_addr = [fd00:1122:3344:101::1]:38411 method = GET remote_addr = [fd00:1122:3344:101::d]:63395 req_id = d3616258-3a12-43c7-89fa-1474a88811cc response_code = 200 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 uri = /84074e7c-1a32-4c31-a122-c0b819b9b406
28662025-03-21T18:51:32.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54623
28672025-03-21T18:51:32.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54623 req_id = d5d67162-fc52-493d-ad2c-bde1b6354d2f response_code = 200 uri = /v2p
28682025-03-21T18:51:32.645ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(13321847) }
28692025-03-21T18:51:32.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54623 req_id = 69e72757-4334-4c56-b529-9b6b16f80d6c response_code = 204 uri = /v2p
28702025-03-21T18:51:32.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58343
28712025-03-21T18:51:32.868ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13321847))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: b7ea0bde-04d4-46bb-b017-234ee2620d63, slot: 0, read_only: false, vcr_json: .., name: "disk-9da41b872bf" }], boot_settings: Some(InstanceBootSettings { order: [b7ea0bde-04d4-46bb-b017-234ee2620d63] }), cloud_init_bytes: Some(..) } instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede metadata = InstanceMetadata { silo_id: 972a035e-783f-405d-837d-8f47e0bd1cc9, project_id: 590d719d-18da-48ba-8c88-f87f122c862b } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-21T18:51:32.858715011Z }
28722025-03-21T18:51:32.868ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede migration_id = None propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
28732025-03-21T18:51:32.868ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede migration_id = None propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13321847))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: afcd5669-f8f9-4c61-aaea-98f92112503c, kind: Instance { id: 2e043448-9b3e-4d1e-90e9-37166adf0ede }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13321847), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: b7ea0bde-04d4-46bb-b017-234ee2620d63, slot: 0, read_only: false, vcr_json: .., name: "disk-9da41b872bf" }], boot_settings: Some(InstanceBootSettings { order: [b7ea0bde-04d4-46bb-b017-234ee2620d63] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-21T18:51:32.858715011Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28742025-03-21T18:51:32.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58343 req_id = 1a3fa06c-ea9b-4d81-a8c6-55234557bcfc response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18
28752025-03-21T18:51:32.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59478
28762025-03-21T18:51:32.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59478 req_id = f60ea80f-b273-4d88-bf8e-e30436f3b4e4 response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18/state
28772025-03-21T18:51:32.998ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 13321847 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28782025-03-21T18:51:32.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28792025-03-21T18:51:33.039ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18 file = illumos-utils/src/zone.rs:327 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
28802025-03-21T18:51:33.063ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18 file = illumos-utils/src/zone.rs:365 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
28812025-03-21T18:51:33.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54515
28822025-03-21T18:51:33.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54515 req_id = 6692fa59-8ae4-4430-b315-46ee77d789be response_code = 200 uri = /vpc-routes
28832025-03-21T18:51:33.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {afcd5669-f8f9-4c61-aaea-98f92112503c: {10.151.1.176: {549a6b5b-225c-47d2-ad95-5704a0753fd0}, 10.151.1.175: {549a6b5b-225c-47d2-ad95-5704a0753fd0}}} }
28842025-03-21T18:51:34.691ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
28852025-03-21T18:51:34.692ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18 zone file = illumos-utils/src/running_zone.rs:491 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28862025-03-21T18:51:34.866ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 39.586432ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28872025-03-21T18:51:34.917ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 63.752505ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28882025-03-21T18:51:34.996ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 238.425521ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28892025-03-21T18:51:35.248ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 209.004159ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28902025-03-21T18:51:35.472ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 469.13724ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28912025-03-21T18:51:35.957ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 1.313036716s file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28922025-03-21T18:51:37.282ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 724.618317ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28932025-03-21T18:51:38.018ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 1.289159498s file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
28942025-03-21T18:51:38.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56698
28952025-03-21T18:51:38.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39888
28962025-03-21T18:51:38.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39888 req_id = 56536018-669b-4c95-96d0-63ab3d32a2d1 response_code = 200 uri = /vpc-routes
28972025-03-21T18:51:38.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33067
28982025-03-21T18:51:38.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53583
28992025-03-21T18:51:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53583 req_id = 208cb745-c62a-4929-a5f9-60b0077f2ba5 response_code = 200 uri = /v2p
29002025-03-21T18:51:38.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {afcd5669-f8f9-4c61-aaea-98f92112503c: {10.151.1.176: {549a6b5b-225c-47d2-ad95-5704a0753fd0}, 10.151.1.175: {549a6b5b-225c-47d2-ad95-5704a0753fd0}}} }
29012025-03-21T18:51:38.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39888 req_id = e58339c5-ccdf-4243-808d-1e799f119cdb response_code = 204 uri = /eip-gateways
29022025-03-21T18:51:38.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43461
29032025-03-21T18:51:38.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43461 req_id = 1cbfccbd-1e7f-43f2-aa97-06ac641fc059 response_code = 200 uri = /vpc-routes
29042025-03-21T18:51:38.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49726
29052025-03-21T18:51:38.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61532
29062025-03-21T18:51:38.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61532 req_id = 8d699ef1-af76-4c70-b6c1-d382256ff9f4 response_code = 200 uri = /v2p
29072025-03-21T18:51:38.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34387
29082025-03-21T18:51:38.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34387 req_id = cbbd7c70-58f6-4476-9cbb-8b7107e6e218 response_code = 200 uri = /v2p
29092025-03-21T18:51:38.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55076
29102025-03-21T18:51:38.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29112025-03-21T18:51:38.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29122025-03-21T18:51:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55076 req_id = 30f1b2d2-aeaf-4e62-b619-2cbbad6e2905 response_code = 204 uri = /switch-ports
29132025-03-21T18:51:39.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63747
29142025-03-21T18:51:39.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29152025-03-21T18:51:39.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {afcd5669-f8f9-4c61-aaea-98f92112503c: {10.151.1.176: {549a6b5b-225c-47d2-ad95-5704a0753fd0}, 10.151.1.175: {549a6b5b-225c-47d2-ad95-5704a0753fd0}}} }
29162025-03-21T18:51:39.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55076 req_id = 1018f424-7a46-4bbb-b962-b8b002e4b78e response_code = 200 uri = /network-bootstore-config
29172025-03-21T18:51:39.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43461 req_id = 6ab43a21-31d1-4b6f-b048-8da6b6301b39 response_code = 204 uri = /eip-gateways
29182025-03-21T18:51:39.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4833 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39888 req_id = cfae5c18-1727-4000-a55b-84295ec5d22e response_code = 204 uri = /vpc-routes
29192025-03-21T18:51:39.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61305
29202025-03-21T18:51:39.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29212025-03-21T18:51:39.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29222025-03-21T18:51:39.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63747 req_id = 144f6a38-a373-425f-8a13-0ce3ae296e9b response_code = 204 uri = /switch-ports
29232025-03-21T18:51:39.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63747 req_id = fd025e91-ef87-4180-ba80-2e903af22628 response_code = 200 uri = /network-bootstore-config
29242025-03-21T18:51:39.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29252025-03-21T18:51:39.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61305 req_id = c23617ba-ce94-4e63-bda7-4ef230add29e response_code = 204 uri = /switch-ports
29262025-03-21T18:51:39.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61305 req_id = 0a8d7f66-07d0-49ad-a9f6-7e065e2dcb53 response_code = 200 uri = /network-bootstore-config
29272025-03-21T18:51:39.246ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: d06e6cd2-03f8-4f63-a542-ceb1207484d4, version: 3 } old_vers = RouterVersion { router_id: d06e6cd2-03f8-4f63-a542-ceb1207484d4, version: 3 } subnet = RouterId { vni: Vni(13321847), kind: System }
29282025-03-21T18:51:39.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43461 req_id = 6666462d-1637-4a1d-940a-c6c855d3e405 response_code = 204 uri = /vpc-routes
29292025-03-21T18:51:39.318ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 701.957899ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 zone = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
29302025-03-21T18:51:40.050ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18 file = sled-agent/src/instance.rs:2133 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29312025-03-21T18:51:40.061ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 64.664633ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29322025-03-21T18:51:40.136ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 83.31694ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29332025-03-21T18:51:40.231ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 265.360659ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29342025-03-21T18:51:40.507ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18") failed: Property not found. retry in 530.748751ms file = illumos-utils/src/svc.rs:42 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29352025-03-21T18:51:41.050ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29362025-03-21T18:51:41.087ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29372025-03-21T18:51:41.169ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29382025-03-21T18:51:41.171ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
29392025-03-21T18:51:41.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2279388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49726 req_id = ae6038f4-75b6-471e-b50e-13e5bef1b3bc response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18/state
29402025-03-21T18:51:41.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8037862 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54515 req_id = a0ff5bd7-145e-4596-8d3b-cef3a10527f8 response_code = 204 uri = /eip-gateways
29412025-03-21T18:51:41.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2495547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56698 req_id = deff9592-bb61-49b6-9f61-60c6950464bf response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18/state
29422025-03-21T18:51:41.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2390320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33067 req_id = 60f8ae9e-9bf4-458b-b724-11bfc46c4968 response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18/state
29432025-03-21T18:51:41.171ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-21T18:51:41.171723321Z } file = sled-agent/src/instance.rs:842 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29442025-03-21T18:51:41.171ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-21T18:51:41.171723321Z } propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29452025-03-21T18:51:41.171ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-21T18:51:41.171723321Z }, migration_in: None, migration_out: None }
29462025-03-21T18:51:41.189ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-21T18:51:41.189979312Z } file = sled-agent/src/instance.rs:842 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29472025-03-21T18:51:41.190ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-21T18:51:41.189979312Z } propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29482025-03-21T18:51:41.190ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-21T18:51:41.189979312Z }, migration_in: None, migration_out: None }
29492025-03-21T18:51:41.374ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: d06e6cd2-03f8-4f63-a542-ceb1207484d4, version: 3 } old_vers = RouterVersion { router_id: d06e6cd2-03f8-4f63-a542-ceb1207484d4, version: 3 } subnet = RouterId { vni: Vni(13321847), kind: System }
29502025-03-21T18:51:41.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54515 req_id = 963c36b0-c6d9-4437-acc0-b14888b95ab6 response_code = 204 uri = /vpc-routes
29512025-03-21T18:51:41.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45198
29522025-03-21T18:51:41.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45198 req_id = c6919bd6-f93d-4355-8332-1873ffd633cb response_code = 200 uri = /vpc-routes
29532025-03-21T18:51:41.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {afcd5669-f8f9-4c61-aaea-98f92112503c: {10.151.1.175: {549a6b5b-225c-47d2-ad95-5704a0753fd0}, 10.151.1.176: {549a6b5b-225c-47d2-ad95-5704a0753fd0}}} }
29542025-03-21T18:51:41.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45198 req_id = 3af7408e-446a-4ade-b72f-121055c12389 response_code = 204 uri = /eip-gateways
29552025-03-21T18:51:41.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45198 req_id = 9c1a0351-1bb6-40b6-9447-6c098d104c4e response_code = 204 uri = /vpc-routes
29562025-03-21T18:51:50.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41767
29572025-03-21T18:51:50.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41767 req_id = 6b773141-90d7-4ac9-8da6-8b55b54f4ed5 response_code = 200 uri = /vmms/43b29047-12d5-4544-a543-ea35ceb08d18/state
29582025-03-21T18:51:50.818ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-21T18:51:50.818086951Z } file = sled-agent/src/instance.rs:842 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29592025-03-21T18:51:50.818ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-21T18:51:50.818086951Z } propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29602025-03-21T18:51:50.818ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-21T18:51:50.818086951Z }, migration_in: None, migration_out: None }
29612025-03-21T18:51:50.826ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopped), migration_in: None, migration_out: None, time: 2025-03-21T18:51:50.826466838Z } file = sled-agent/src/instance.rs:842 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29622025-03-21T18:51:50.826ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2025-03-21T18:51:50.826466838Z } propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29632025-03-21T18:51:50.826ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2025-03-21T18:51:50.826466838Z }, migration_in: None, migration_out: None }
29642025-03-21T18:51:50.836ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-21T18:51:50.836353552Z } file = sled-agent/src/instance.rs:842 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29652025-03-21T18:51:50.836ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-21T18:51:50.836353552Z } propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29662025-03-21T18:51:50.836ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29672025-03-21T18:51:50.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29682025-03-21T18:51:50.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29692025-03-21T18:51:50.836ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/34819322-8562-4c8b-95bf-c8903d7e9c97/debug/bundle/zone", "/pool/int/eabe7796-89f9-4e63-b1df-63201e46213d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2219f396-1299-4176-91e7-626a9f13bedc/crypt/debug", "/pool/ext/8ce58dda-7f2f-4b41-971e-1f0b36d8e9fe/crypt/debug", "/pool/ext/93f27406-584f-49b0-bbdf-aec064c7573f/crypt/debug", "/pool/ext/47056192-ed60-41f0-aecf-23ae41e9cb50/crypt/debug", "/pool/ext/5519ee6b-7309-4026-8ae2-5d5e1df07ffb/crypt/debug", "/pool/ext/b3e248cb-26a3-4cbb-84d7-39726ac275ba/crypt/debug", "/pool/ext/062d3677-bd7e-4b38-a486-3ce5e79fd3a9/crypt/debug", "/pool/ext/71dc428d-9d1f-483c-b923-af3efe9583af/crypt/debug", "/pool/ext/746ded48-1093-4fb4-a064-8507518ef38c/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18
29702025-03-21T18:51:51.473ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1144 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18", bundle_id: 8755ab08-9e4f-4ea8-ae8e-dedd3d9e5232 }, time_created: 2025-03-21T18:51:50.837289828Z, version: 0, cause: TerminatedInstance }
29712025-03-21T18:51:51.473ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_43b29047-12d5-4544-a543-ea35ceb08d18 file = sled-agent/src/instance.rs:1376 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29722025-03-21T18:51:53.238ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:281 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29732025-03-21T18:51:53.256ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(13321847), kind: System }
29742025-03-21T18:51:53.256ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(13321847), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29752025-03-21T18:51:53.256ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2025-03-21T18:51:53.256866378Z }, migration_in: None, migration_out: None }
29762025-03-21T18:51:53.285ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2025-03-21T18:51:53.256866378Z }, migration_in: None, migration_out: None }
29772025-03-21T18:51:53.290ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 2e043448-9b3e-4d1e-90e9-37166adf0ede propolis_id = 43b29047-12d5-4544-a543-ea35ceb08d18
29782025-03-21T18:51:53.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57122
29792025-03-21T18:51:53.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57122 req_id = a16433a5-b6d1-4130-b7ba-95d80b27e117 response_code = 200 uri = /vpc-routes
29802025-03-21T18:51:53.765ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {afcd5669-f8f9-4c61-aaea-98f92112503c: {10.151.1.176: {549a6b5b-225c-47d2-ad95-5704a0753fd0}, 10.151.1.175: {549a6b5b-225c-47d2-ad95-5704a0753fd0}}} }
29812025-03-21T18:51:53.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57122 req_id = ce5f3e96-d9b9-4b84-b6ac-dafc8149392d response_code = 204 uri = /eip-gateways
29822025-03-21T18:51:53.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57122 req_id = 217a6e88-bde8-4b50-b303-08eaf39ab930 response_code = 204 uri = /vpc-routes
29832025-03-21T18:51:53.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51942
29842025-03-21T18:51:53.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51942 req_id = 40fd3d40-218f-4d97-907a-17043fbbb7ef response_code = 200 uri = /v2p
29852025-03-21T18:51:54.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58139
29862025-03-21T18:51:54.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58139 req_id = 95290cf2-7908-4791-a8a6-4d36d99e41a4 response_code = 200 uri = /v2p
29872025-03-21T18:51:54.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32829
29882025-03-21T18:51:54.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32829 req_id = 4520d471-5f12-497b-808a-5e4a759b1679 response_code = 200 uri = /vpc-routes
29892025-03-21T18:51:54.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
29902025-03-21T18:51:54.072ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406
29912025-03-21T18:51:54.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32829 req_id = c14acae2-e33c-4a47-8a70-da227a0d147a response_code = 204 uri = /eip-gateways
29922025-03-21T18:51:54.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 425 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32829 req_id = 393305bc-fde1-4df5-82a0-2480934e2812 response_code = 204 uri = /vpc-routes
29932025-03-21T18:51:54.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41570
29942025-03-21T18:51:54.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41570 req_id = 9929cba9-97e9-43ee-8f72-ce41c41df766 response_code = 200 uri = /vpc-routes
29952025-03-21T18:51:54.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 84074e7c-1a32-4c31-a122-c0b819b9b406 values = ExternalIpGatewayMap { mappings: {} }
29962025-03-21T18:51:54.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41570 req_id = 1e365a8a-6592-40cc-832d-4a88c618c558 response_code = 204 uri = /eip-gateways
29972025-03-21T18:51:54.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41570 req_id = 23101216-805c-44b6-9f7a-a8f504727e8c response_code = 204 uri = /vpc-routes
29982025-03-21T18:51:55.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49572
29992025-03-21T18:51:55.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49572 req_id = ad06e806-9dbb-40c1-899a-fff8ef9d03d6 response_code = 200 uri = /baseboard