Max level shown:
1 [ Mar 4 05:56:27 Enabled. ]
2 [ Mar 4 05:56:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 4 05:56:27 Method "start" exited with status 0. ]
4 [ Mar 4 05:56:27 Rereading configuration. ]
5 [ Mar 4 05:56:27 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-04T05:56:27.386ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-04T05:56:27.386ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-04T05:56:27.440ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-04T05:56:27.440ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-04T05:56:27.554ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-04T05:56:27.562ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-04T05:56:27.571ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-04T05:56:28.182ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
152025-03-04T05:56:28.184ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }]
162025-03-04T05:56:28.184ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
172025-03-04T05:56:28.313ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-04T05:56:28.313ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-04T05:56:28.313ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-04T05:56:28.313ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
212025-03-04T05:56:28.313ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
222025-03-04T05:56:28.313ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
232025-03-04T05:56:28.316ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-04T05:56:28.316ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-04T05:56:28.316ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-04T05:56:28.316ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-04T05:56:28.316ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-04T05:56:28.316ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-04T05:56:28.316ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-04T05:56:28.316ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-04T05:56:28.316ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-04T05:56:28.328ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-04T05:56:28.328ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool)
342025-03-04T05:56:28.426ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal }
352025-03-04T05:56:28.778ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-04T05:56:28.778ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-04T05:56:28.778ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-04T05:56:28.778ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-04T05:56:28.778ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-04T05:56:28.778ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-04T05:56:28.778ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-04T05:56:28.787ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-04T05:56:28.787ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool)
442025-03-04T05:56:28.872ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal }
452025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
492025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
502025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
542025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
552025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
562025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
602025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
612025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
622025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
792025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
802025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
812025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
852025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
862025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
872025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
882025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
912025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
922025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
932025-03-04T05:56:29.232ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
942025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
972025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
982025-03-04T05:56:29.232ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
992025-03-04T05:56:29.232ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-04T05:56:29.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-04T05:56:29.232ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1032025-03-04T05:56:29.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1042025-03-04T05:56:29.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1052025-03-04T05:56:29.232ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1072025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1082025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1092025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1102025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1112025-03-04T05:56:29.232ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1122025-03-04T05:56:29.232ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-04T05:56:29.232ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-04T05:56:29.243ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:794
1152025-03-04T05:56:29.243ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1494, tv_nsec: 721802303 } time_to_next_cleanup = 599.999917049s
1162025-03-04T05:56:29.244ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
1172025-03-04T05:56:29.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-04T05:56:29.244ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-04T05:56:29.244ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-04T05:56:29.247ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1212025-03-04T05:56:29.249ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1222025-03-04T05:56:29.249ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1257
1232025-03-04T05:56:29.249ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-04T05:56:29.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-04T05:56:29.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-04T05:56:29.249ZINFOSledAgent (RSS): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-04T05:56:29.249ZINFOSledAgent (RSS): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-04T05:56:29.249ZINFOSledAgent (RSS): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-04T05:56:29.249ZINFOSledAgent (RSS): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-04T05:56:29.249ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1306
1312025-03-04T05:56:29.249ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-04T05:56:29.250ZINFOSledAgent (RSS): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-04T05:56:29.250ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1338
1342025-03-04T05:56:29.250ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-04T05:56:29.250ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-04T05:56:29.250ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1369
1372025-03-04T05:56:29.250ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382025-03-04T05:56:29.250ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1392025-03-04T05:56:29.250ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1402025-03-04T05:56:29.250ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412025-03-04T05:56:29.250ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: dbce58b0-062a-4b73-bfbe-866ce6aaea71 (sled), rack_id: d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422025-03-04T05:56:29.251ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4319
1432025-03-04T05:56:29.251ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4740
1442025-03-04T05:56:29.255ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-04T05:56:29.261ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-04T05:56:29.261ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-04T05:56:29.266ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-04T05:56:29.266ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-04T05:56:29.266ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43027
1502025-03-04T05:56:29.266ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: dbce58b0-062a-4b73-bfbe-866ce6aaea71 (sled), rack_id: d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:358
1512025-03-04T05:56:29.266ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:373
1522025-03-04T05:56:29.266ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-04T05:56:29.266ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1552025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-04T05:56:29.266ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1622025-03-04T05:56:29.266ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-04T05:56:29.283ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-04T05:56:29.304ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:327
1652025-03-04T05:56:29.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:365
1662025-03-04T05:56:29.329ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1672025-03-04T05:56:29.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1682025-03-04T05:56:29.329ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1692025-03-04T05:56:29.329ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
1702025-03-04T05:56:29.332ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1712025-03-04T05:56:29.332ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
1722025-03-04T05:56:29.332ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
1732025-03-04T05:56:29.333ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5fbb09bc-7ae4-40b9-9c07-176ca8ee60e3", "content-length": "124", "date": "Tue, 04 Mar 2025 05:56:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5fbb09bc-7ae4-40b9-9c07-176ca8ee60e3" } file = sled-agent/src/ddm_reconciler.rs:193
1742025-03-04T05:56:29.343ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_8bb0ee9e-3f42-456f-a81e-20fe8e95e989/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-04T05:56:29.365ZINFOSledAgent: successfully created encrypted zvol: name="oxi_8bb0ee9e-3f42-456f-a81e-20fe8e95e989/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-04T05:56:29.365ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_8bb0ee9e-3f42-456f-a81e-20fe8e95e989/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-04T05:56:29.370ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1782025-03-04T05:56:29.370ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-04T05:56:29.370ZINFOSledAgent (BackingFs): Ensuring dataset oxi_8bb0ee9e-3f42-456f-a81e-20fe8e95e989/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-04T05:56:29.441ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-04T05:56:29.660ZINFOSledAgent (BackingFs): Mounting oxi_8bb0ee9e-3f42-456f-a81e-20fe8e95e989/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-04T05:56:29.673ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-04T05:56:29.673ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-04T05:56:29.673ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-04T05:56:29.673ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-04T05:56:30.408ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1872025-03-04T05:56:30.413ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:64530 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1882025-03-04T05:56:30.413ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1892025-03-04T05:56:30.413ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:64530 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1902025-03-04T05:56:30.415ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 181.605634ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1912025-03-04T05:56:30.415ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1922025-03-04T05:56:30.415ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1932025-03-04T05:56:30.415ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:981 underlay_address = fd00:1122:3344:101::1
1942025-03-04T05:56:30.415ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-04T05:56:30.598ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 305.093122ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1962025-03-04T05:56:30.905ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 772.169557ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1972025-03-04T05:56:31.679ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.848334666s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
1982025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2737
1992025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2967
2002025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2607
2012025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2654
2022025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3048
2032025-03-04T05:56:33.370ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3093
2042025-03-04T05:56:33.371ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2875
2052025-03-04T05:56:33.373ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2648
2062025-03-04T05:56:33.373ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f14b1f4a-55a3-4bd4-a4c3-6defd054a82b'/> <propval type="astring" name="rack_id" value='d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe18:a488'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb'/> <propval type="astring" name="sled_id" value='dbce58b0-062a-4b73-bfbe-866ce6aaea71'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb'/> <propval type="astring" name="sled_id" value='dbce58b0-062a-4b73-bfbe-866ce6aaea71'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='dbce58b0-062a-4b73-bfbe-866ce6aaea71'/> <propval type="astring" name="rack_uuid" value='d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='dbce58b0-062a-4b73-bfbe-866ce6aaea71'/> <propval type="astring" name="rack_uuid" value='d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2072025-03-04T05:56:33.373ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2082025-03-04T05:56:33.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 62.927618ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2092025-03-04T05:56:33.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 109.652901ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-04T05:56:34.067ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 210.592284ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-04T05:56:34.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 566.448598ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-04T05:56:34.528ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.519612473s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2132025-03-04T05:56:35.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 405.13693ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2142025-03-04T05:56:35.705ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.186898736s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-04T05:56:37.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.192116042s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-04T05:56:38.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 842.362544ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-04T05:56:39.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2182025-03-04T05:56:39.684ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2192025-03-04T05:56:39.685ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2202025-03-04T05:56:39.685ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:423
2212025-03-04T05:56:39.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2222025-03-04T05:56:39.685ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2232025-03-04T05:56:39.685ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2242025-03-04T05:56:39.685ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2252025-03-04T05:56:39.686ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2262025-03-04T05:56:39.686ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
2272025-03-04T05:56:39.686ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43027
2282025-03-04T05:56:39.887ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2292025-03-04T05:56:39.887ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2302025-03-04T05:56:39.893ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4343 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2312025-03-04T05:56:39.893ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4359
2322025-03-04T05:56:39.893ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2332025-03-04T05:56:40.098ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.647102481s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2342025-03-04T05:56:40.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52691
2352025-03-04T05:56:40.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2362025-03-04T05:56:40.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2372025-03-04T05:56:40.125ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:186
2382025-03-04T05:56:40.125ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:186
2392025-03-04T05:56:40.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52691 req_id = fb760cf0-32d4-4049-aa5b-7fb5f120b3ef response_code = 200 uri = /inventory
2402025-03-04T05:56:40.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49070
2412025-03-04T05:56:40.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49070 req_id = 2a7d205f-75e8-494f-b477-b23508194f19 response_code = 200 uri = /sled-role
2422025-03-04T05:56:40.188ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 000ca2de-3bb4-4299-9049-40fb41d8d196 (physical_disk), pool_id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 03eacee8-6669-4d31-9f49-1fd97a59925e (physical_disk), pool_id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3bbfed8a-e9f6-40a0-a263-64b9db0480df (physical_disk), pool_id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3f78fcbe-f8c7-4ed8-9a37-20c54d197889 (physical_disk), pool_id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4c71d58a-728e-4cbb-8111-012873668c23 (physical_disk), pool_id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 8ddb3ca5-71d6-4aea-bb39-25ea79bb974e (physical_disk), pool_id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c01e1ab5-4c1e-48a6-a0e6-b284b1e4ac13 (physical_disk), pool_id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cd694a11-e70b-474d-aaa2-a4db071f1e32 (physical_disk), pool_id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d47352f7-6867-410d-938c-911394b6fcde (physical_disk), pool_id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool) }] } file = sled-agent/src/rack_setup/service.rs:399 sled_address = [fd00:1122:3344:101::1]:12345
2432025-03-04T05:56:40.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57609
2442025-03-04T05:56:40.189ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2452025-03-04T05:56:40.189ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 000ca2de-3bb4-4299-9049-40fb41d8d196 (physical_disk), pool_id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 03eacee8-6669-4d31-9f49-1fd97a59925e (physical_disk), pool_id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3bbfed8a-e9f6-40a0-a263-64b9db0480df (physical_disk), pool_id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3f78fcbe-f8c7-4ed8-9a37-20c54d197889 (physical_disk), pool_id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4c71d58a-728e-4cbb-8111-012873668c23 (physical_disk), pool_id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 8ddb3ca5-71d6-4aea-bb39-25ea79bb974e (physical_disk), pool_id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c01e1ab5-4c1e-48a6-a0e6-b284b1e4ac13 (physical_disk), pool_id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cd694a11-e70b-474d-aaa2-a4db071f1e32 (physical_disk), pool_id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d47352f7-6867-410d-938c-911394b6fcde (physical_disk), pool_id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2462025-03-04T05:56:40.189ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2472025-03-04T05:56:40.189ZINFOSledAgent (StorageManager): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2482025-03-04T05:56:40.189ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1301 request = omicron_physical_disks_ensure
2492025-03-04T05:56:40.189ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2502025-03-04T05:56:40.189ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2512025-03-04T05:56:40.189ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2522025-03-04T05:56:40.189ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2532025-03-04T05:56:40.346ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2542025-03-04T05:56:40.346ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool)
2552025-03-04T05:56:40.566ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10081812616642580904 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2562025-03-04T05:56:40.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7483247701201380882 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2572025-03-04T05:56:40.773ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2582025-03-04T05:56:40.775ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
2592025-03-04T05:56:40.834ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }
2602025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2612025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2622025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2632025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2642025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2652025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2662025-03-04T05:56:40.843ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2672025-03-04T05:56:40.878ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2682025-03-04T05:56:40.885ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone file = sled-storage/src/dataset.rs:304
2692025-03-04T05:56:41.023ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1c45276e-4032-4af7-b0dd-228abf1563e5 file = sled-storage/src/dataset.rs:390
2702025-03-04T05:56:41.032ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2712025-03-04T05:56:41.032ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2722025-03-04T05:56:41.032ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2732025-03-04T05:56:41.032ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2742025-03-04T05:56:41.032ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2752025-03-04T05:56:41.042ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2762025-03-04T05:56:41.042ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool)
2772025-03-04T05:56:41.140ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }
2782025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2792025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2802025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2812025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2822025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2832025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2842025-03-04T05:56:41.148ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2852025-03-04T05:56:41.182ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2862025-03-04T05:56:41.190ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone file = sled-storage/src/dataset.rs:304
2872025-03-04T05:56:41.329ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1 file = sled-storage/src/dataset.rs:390
2882025-03-04T05:56:41.337ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2892025-03-04T05:56:41.337ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2902025-03-04T05:56:41.337ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2912025-03-04T05:56:41.337ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922025-03-04T05:56:41.337ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2932025-03-04T05:56:41.347ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2942025-03-04T05:56:41.347ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool)
2952025-03-04T05:56:41.442ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }
2962025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
2972025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
2982025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
2992025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3002025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3012025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3022025-03-04T05:56:41.450ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3032025-03-04T05:56:41.484ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3042025-03-04T05:56:41.491ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone file = sled-storage/src/dataset.rs:304
3052025-03-04T05:56:41.620ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8 file = sled-storage/src/dataset.rs:390
3062025-03-04T05:56:41.629ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3072025-03-04T05:56:41.629ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3082025-03-04T05:56:41.629ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3092025-03-04T05:56:41.629ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3102025-03-04T05:56:41.629ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3112025-03-04T05:56:41.638ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3122025-03-04T05:56:41.638ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool)
3132025-03-04T05:56:41.730ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }
3142025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3152025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3162025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3172025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3182025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3192025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3202025-03-04T05:56:41.738ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3212025-03-04T05:56:41.773ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3222025-03-04T05:56:41.776ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
3232025-03-04T05:56:41.781ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone file = sled-storage/src/dataset.rs:304
3242025-03-04T05:56:41.911ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0 file = sled-storage/src/dataset.rs:390
3252025-03-04T05:56:41.918ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3262025-03-04T05:56:41.918ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3272025-03-04T05:56:41.918ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3282025-03-04T05:56:41.918ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3292025-03-04T05:56:41.918ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3302025-03-04T05:56:41.927ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3312025-03-04T05:56:41.927ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool)
3322025-03-04T05:56:42.017ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }
3332025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3342025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3352025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3362025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3372025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3382025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3392025-03-04T05:56:42.024ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3402025-03-04T05:56:42.057ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3412025-03-04T05:56:42.064ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone file = sled-storage/src/dataset.rs:304
3422025-03-04T05:56:42.205ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b file = sled-storage/src/dataset.rs:390
3432025-03-04T05:56:42.214ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3442025-03-04T05:56:42.214ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3452025-03-04T05:56:42.214ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3462025-03-04T05:56:42.214ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3472025-03-04T05:56:42.214ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3482025-03-04T05:56:42.223ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3492025-03-04T05:56:42.223ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool)
3502025-03-04T05:56:42.316ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }
3512025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3522025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3532025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3542025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3552025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3562025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3572025-03-04T05:56:42.324ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3582025-03-04T05:56:42.359ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3592025-03-04T05:56:42.367ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone file = sled-storage/src/dataset.rs:304
3602025-03-04T05:56:42.506ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b file = sled-storage/src/dataset.rs:390
3612025-03-04T05:56:42.514ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3622025-03-04T05:56:42.514ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3632025-03-04T05:56:42.514ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3642025-03-04T05:56:42.514ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3652025-03-04T05:56:42.514ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3662025-03-04T05:56:42.524ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3672025-03-04T05:56:42.524ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 862379c5-061f-49d2-8232-148b101e17d0 (zpool)
3682025-03-04T05:56:42.619ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }
3692025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3702025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3712025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3722025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3732025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3742025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3752025-03-04T05:56:42.627ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3762025-03-04T05:56:42.663ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3772025-03-04T05:56:42.671ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/zone file = sled-storage/src/dataset.rs:304
3782025-03-04T05:56:42.778ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
3792025-03-04T05:56:42.811ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_862379c5-061f-49d2-8232-148b101e17d0 file = sled-storage/src/dataset.rs:390
3802025-03-04T05:56:42.819ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3812025-03-04T05:56:42.819ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3822025-03-04T05:56:42.819ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3832025-03-04T05:56:42.819ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3842025-03-04T05:56:42.819ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3852025-03-04T05:56:42.829ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3862025-03-04T05:56:42.829ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool)
3872025-03-04T05:56:42.926ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }
3882025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3892025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3902025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3912025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3922025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3932025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3942025-03-04T05:56:42.934ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3952025-03-04T05:56:42.969ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962025-03-04T05:56:42.977ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone file = sled-storage/src/dataset.rs:304
3972025-03-04T05:56:43.115ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f file = sled-storage/src/dataset.rs:390
3982025-03-04T05:56:43.123ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
3992025-03-04T05:56:43.123ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4002025-03-04T05:56:43.123ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4012025-03-04T05:56:43.123ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4022025-03-04T05:56:43.123ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4032025-03-04T05:56:43.134ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4042025-03-04T05:56:43.134ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool)
4052025-03-04T05:56:43.230ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }
4062025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4072025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4082025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4092025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4102025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4122025-03-04T05:56:43.238ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4132025-03-04T05:56:43.273ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4142025-03-04T05:56:43.281ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/zone file = sled-storage/src/dataset.rs:304
4152025-03-04T05:56:43.426ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1 file = sled-storage/src/dataset.rs:390
4162025-03-04T05:56:43.434ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4172025-03-04T05:56:43.434ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4182025-03-04T05:56:43.434ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4192025-03-04T05:56:43.434ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bb0ee9e-3f42-456f-a81e-20fe8e95e989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4202025-03-04T05:56:43.434ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4212025-03-04T05:56:43.434ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4222025-03-04T05:56:43.435ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4232025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4242025-03-04T05:56:43.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4252025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4262025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4272025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4282025-03-04T05:56:43.435ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4292025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4302025-03-04T05:56:43.435ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4312025-03-04T05:56:43.435ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4322025-03-04T05:56:43.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3246345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57609 req_id = 8b24d834-148e-4cf0-86c8-990eee31eb28 response_code = 200 uri = /omicron-physical-disks
4332025-03-04T05:56:43.469ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {059f8f4c-5df5-425b-a692-6095868e299e (dataset): DatasetConfig { id: 059f8f4c-5df5-425b-a692-6095868e299e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05ef6b5a-ce50-4607-b0a8-e43ae08b1e76 (dataset): DatasetConfig { id: 05ef6b5a-ce50-4607-b0a8-e43ae08b1e76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08c0f2c6-404e-43c6-8ac9-a48b27112b3c (dataset): DatasetConfig { id: 08c0f2c6-404e-43c6-8ac9-a48b27112b3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 179cd4ff-2a00-46b7-9741-4f903ffff72d (dataset): DatasetConfig { id: 179cd4ff-2a00-46b7-9741-4f903ffff72d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18aa7dff-1703-4fe4-8cc1-5c9b0b51efed (dataset): DatasetConfig { id: 18aa7dff-1703-4fe4-8cc1-5c9b0b51efed (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19fe6877-c490-4d3c-a59c-df96dee83888 (dataset): DatasetConfig { id: 19fe6877-c490-4d3c-a59c-df96dee83888 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a495f2e-d87b-4c19-b841-fc04ff324b90 (dataset): DatasetConfig { id: 1a495f2e-d87b-4c19-b841-fc04ff324b90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25396409-2e82-4f8b-832f-c7466c0719f5 (dataset): DatasetConfig { id: 25396409-2e82-4f8b-832f-c7466c0719f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27b214aa-f03d-4e81-8ea6-c817e4da7083 (dataset): DatasetConfig { id: 27b214aa-f03d-4e81-8ea6-c817e4da7083 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ee3f7bb-ddc6-4788-8fce-e40c76a13b8f (dataset): DatasetConfig { id: 2ee3f7bb-ddc6-4788-8fce-e40c76a13b8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30ad758e-5bd8-494f-96e2-387bd14d60bf (dataset): DatasetConfig { id: 30ad758e-5bd8-494f-96e2-387bd14d60bf (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30d54a6c-a945-4f8d-b21c-881497eb6e6c (dataset): DatasetConfig { id: 30d54a6c-a945-4f8d-b21c-881497eb6e6c (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3288ed12-2647-431f-9282-578cdcf4e7a0 (dataset): DatasetConfig { id: 3288ed12-2647-431f-9282-578cdcf4e7a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35b68b27-b3b0-4a20-ae28-9325610827e5 (dataset): DatasetConfig { id: 35b68b27-b3b0-4a20-ae28-9325610827e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b378c03c-e24e-431f-a254-c12054011227" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36433dd3-61aa-4f71-8b66-44e3a3dc18eb (dataset): DatasetConfig { id: 36433dd3-61aa-4f71-8b66-44e3a3dc18eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f1e79c2-3f1d-46db-b63d-aafdf556cce9 (dataset): DatasetConfig { id: 3f1e79c2-3f1d-46db-b63d-aafdf556cce9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42141d9b-3987-4f5c-8c24-1f4659f9872f (dataset): DatasetConfig { id: 42141d9b-3987-4f5c-8c24-1f4659f9872f (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 427c6398-a7da-4b1d-acb0-e25f30f9fe51 (dataset): DatasetConfig { id: 427c6398-a7da-4b1d-acb0-e25f30f9fe51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44fa0493-7884-41e9-9fab-d71cb4aa073d (dataset): DatasetConfig { id: 44fa0493-7884-41e9-9fab-d71cb4aa073d (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb670d3-d201-47e0-bf2c-8f38f3d05780 (dataset): DatasetConfig { id: 4cb670d3-d201-47e0-bf2c-8f38f3d05780 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53c35ebb-0d73-41b2-9561-a15f8b67dcae (dataset): DatasetConfig { id: 53c35ebb-0d73-41b2-9561-a15f8b67dcae (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56766a84-c6ae-42aa-afef-55f582a3b8a8 (dataset): DatasetConfig { id: 56766a84-c6ae-42aa-afef-55f582a3b8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58d3aed7-2df8-4740-b87f-263704edbfc0 (dataset): DatasetConfig { id: 58d3aed7-2df8-4740-b87f-263704edbfc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bb3c770-9e11-4ddf-96ab-03bdf308bdd3 (dataset): DatasetConfig { id: 5bb3c770-9e11-4ddf-96ab-03bdf308bdd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dfd37ef-0864-402a-808b-b85aa5733df0 (dataset): DatasetConfig { id: 5dfd37ef-0864-402a-808b-b85aa5733df0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e451c3c-6833-4c67-838b-68fe4958bde8 (dataset): DatasetConfig { id: 5e451c3c-6833-4c67-838b-68fe4958bde8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 60da44b8-e68d-4bd8-b84b-51e9f0ecf81d (dataset): DatasetConfig { id: 60da44b8-e68d-4bd8-b84b-51e9f0ecf81d (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682f85c9-838f-4c73-bc19-72cabf0d52fa (dataset): DatasetConfig { id: 682f85c9-838f-4c73-bc19-72cabf0d52fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68962ef6-7667-4667-a947-0fbc8307e3d6 (dataset): DatasetConfig { id: 68962ef6-7667-4667-a947-0fbc8307e3d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b86b897-b948-49a2-9083-3bc8995d6a34 (dataset): DatasetConfig { id: 6b86b897-b948-49a2-9083-3bc8995d6a34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c7e9517-0eb0-4ce1-bf1a-a8436db25444 (dataset): DatasetConfig { id: 6c7e9517-0eb0-4ce1-bf1a-a8436db25444 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 714f0434-6b5f-4ff7-ae1c-f930ccbf8a86 (dataset): DatasetConfig { id: 714f0434-6b5f-4ff7-ae1c-f930ccbf8a86 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 78ec0266-a2b7-4fc5-bdf3-c931aa2d5c3f (dataset): DatasetConfig { id: 78ec0266-a2b7-4fc5-bdf3-c931aa2d5c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a3bfd07-014f-42c4-b3b4-c6b37e08a2b9 (dataset): DatasetConfig { id: 7a3bfd07-014f-42c4-b3b4-c6b37e08a2b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d55379c-24ea-4536-9b49-420b016c416d (dataset): DatasetConfig { id: 7d55379c-24ea-4536-9b49-420b016c416d (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f29e21e-ecf6-41fd-81d4-846c7e12b66f (dataset): DatasetConfig { id: 7f29e21e-ecf6-41fd-81d4-846c7e12b66f (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8395e8ae-9a4c-4122-ad95-2ccb695ec51e (dataset): DatasetConfig { id: 8395e8ae-9a4c-4122-ad95-2ccb695ec51e (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84034e90-423b-4cac-bacd-7fb9b1c00a75 (dataset): DatasetConfig { id: 84034e90-423b-4cac-bacd-7fb9b1c00a75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8529136c-9cab-4e4a-ad54-836c54027ec7 (dataset): DatasetConfig { id: 8529136c-9cab-4e4a-ad54-836c54027ec7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87a40811-b89b-4ccf-b3fb-269fcf935246 (dataset): DatasetConfig { id: 87a40811-b89b-4ccf-b3fb-269fcf935246 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8823b9d4-1bf1-4a02-be53-d99a453917f9 (dataset): DatasetConfig { id: 8823b9d4-1bf1-4a02-be53-d99a453917f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fc1ca0c-4433-440a-b119-9160346e95b2 (dataset): DatasetConfig { id: 8fc1ca0c-4433-440a-b119-9160346e95b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 954ea72a-635f-4830-a58d-f4a11672d397 (dataset): DatasetConfig { id: 954ea72a-635f-4830-a58d-f4a11672d397 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60a6873-4480-4e51-bc87-20efe7df451a (dataset): DatasetConfig { id: a60a6873-4480-4e51-bc87-20efe7df451a (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acd69e56-d29c-4e4b-a631-bc8eb032a28c (dataset): DatasetConfig { id: acd69e56-d29c-4e4b-a631-bc8eb032a28c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4ea59d1-10a3-4ef7-ac09-7cea0b8a899f (dataset): DatasetConfig { id: b4ea59d1-10a3-4ef7-ac09-7cea0b8a899f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc59c38-17da-4d0a-9ce9-621338256386 (dataset): DatasetConfig { id: bbc59c38-17da-4d0a-9ce9-621338256386 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc93aa8-fa04-48c0-a3a8-d10d68cc1df6 (dataset): DatasetConfig { id: bbc93aa8-fa04-48c0-a3a8-d10d68cc1df6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c2aa7faf-0077-4e9f-b32d-2ec1eef906f4 (dataset): DatasetConfig { id: c2aa7faf-0077-4e9f-b32d-2ec1eef906f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c80cb4f0-064a-453e-8ad9-93c32ebf1501 (dataset): DatasetConfig { id: c80cb4f0-064a-453e-8ad9-93c32ebf1501 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb60b20c-4c2a-46a7-86ca-e1a94ca0b0d1 (dataset): DatasetConfig { id: cb60b20c-4c2a-46a7-86ca-e1a94ca0b0d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbec95b9-6fc9-4696-bdd9-8b81f8430fdb (dataset): DatasetConfig { id: cbec95b9-6fc9-4696-bdd9-8b81f8430fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccb4f561-9ab1-4899-9039-b5e8a59258fb (dataset): DatasetConfig { id: ccb4f561-9ab1-4899-9039-b5e8a59258fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0fcf9c0-6534-4b9e-bb3e-06fd0b5be508 (dataset): DatasetConfig { id: d0fcf9c0-6534-4b9e-bb3e-06fd0b5be508 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d22ba6f3-3aeb-429a-bb71-23dbac833350 (dataset): DatasetConfig { id: d22ba6f3-3aeb-429a-bb71-23dbac833350 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d88866b0-3721-4e68-a6b8-82c09a004546 (dataset): DatasetConfig { id: d88866b0-3721-4e68-a6b8-82c09a004546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db7287b2-ed47-41c6-bd4e-6371ee0a397c (dataset): DatasetConfig { id: db7287b2-ed47-41c6-bd4e-6371ee0a397c (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dedf2353-00e8-4a09-b596-ef831dfa4191 (dataset): DatasetConfig { id: dedf2353-00e8-4a09-b596-ef831dfa4191 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5626b61-df7d-40e3-b6e5-26a231201fa8 (dataset): DatasetConfig { id: e5626b61-df7d-40e3-b6e5-26a231201fa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea6bdb0c-3dc6-4269-82d2-325bd3a8aa89 (dataset): DatasetConfig { id: ea6bdb0c-3dc6-4269-82d2-325bd3a8aa89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eade0d13-3570-4293-84dd-40701c3cbf59 (dataset): DatasetConfig { id: eade0d13-3570-4293-84dd-40701c3cbf59 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f456411e-9796-4c86-8d06-b512177419db (dataset): DatasetConfig { id: f456411e-9796-4c86-8d06-b512177419db (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7e0bd23-1b17-4eba-96ad-182152ab0fd4 (dataset): DatasetConfig { id: f7e0bd23-1b17-4eba-96ad-182152ab0fd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f841da3f-9368-4aac-83e7-b50e165ac912 (dataset): DatasetConfig { id: f841da3f-9368-4aac-83e7-b50e165ac912 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f8ae4024-96d3-4898-87a3-c3ca60255f99 (dataset): DatasetConfig { id: f8ae4024-96d3-4898-87a3-c3ca60255f99 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff6c3aa5-7939-4c0d-961c-91e3bd0f9f19 (dataset): DatasetConfig { id: ff6c3aa5-7939-4c0d-961c-91e3bd0f9f19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:527 sled_address = [fd00:1122:3344:101::1]:12345
4342025-03-04T05:56:43.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53704
4352025-03-04T05:56:43.470ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4362025-03-04T05:56:43.470ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {059f8f4c-5df5-425b-a692-6095868e299e (dataset): DatasetConfig { id: 059f8f4c-5df5-425b-a692-6095868e299e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05ef6b5a-ce50-4607-b0a8-e43ae08b1e76 (dataset): DatasetConfig { id: 05ef6b5a-ce50-4607-b0a8-e43ae08b1e76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08c0f2c6-404e-43c6-8ac9-a48b27112b3c (dataset): DatasetConfig { id: 08c0f2c6-404e-43c6-8ac9-a48b27112b3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 179cd4ff-2a00-46b7-9741-4f903ffff72d (dataset): DatasetConfig { id: 179cd4ff-2a00-46b7-9741-4f903ffff72d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18aa7dff-1703-4fe4-8cc1-5c9b0b51efed (dataset): DatasetConfig { id: 18aa7dff-1703-4fe4-8cc1-5c9b0b51efed (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19fe6877-c490-4d3c-a59c-df96dee83888 (dataset): DatasetConfig { id: 19fe6877-c490-4d3c-a59c-df96dee83888 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a495f2e-d87b-4c19-b841-fc04ff324b90 (dataset): DatasetConfig { id: 1a495f2e-d87b-4c19-b841-fc04ff324b90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25396409-2e82-4f8b-832f-c7466c0719f5 (dataset): DatasetConfig { id: 25396409-2e82-4f8b-832f-c7466c0719f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27b214aa-f03d-4e81-8ea6-c817e4da7083 (dataset): DatasetConfig { id: 27b214aa-f03d-4e81-8ea6-c817e4da7083 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ee3f7bb-ddc6-4788-8fce-e40c76a13b8f (dataset): DatasetConfig { id: 2ee3f7bb-ddc6-4788-8fce-e40c76a13b8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30ad758e-5bd8-494f-96e2-387bd14d60bf (dataset): DatasetConfig { id: 30ad758e-5bd8-494f-96e2-387bd14d60bf (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30d54a6c-a945-4f8d-b21c-881497eb6e6c (dataset): DatasetConfig { id: 30d54a6c-a945-4f8d-b21c-881497eb6e6c (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3288ed12-2647-431f-9282-578cdcf4e7a0 (dataset): DatasetConfig { id: 3288ed12-2647-431f-9282-578cdcf4e7a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35b68b27-b3b0-4a20-ae28-9325610827e5 (dataset): DatasetConfig { id: 35b68b27-b3b0-4a20-ae28-9325610827e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b378c03c-e24e-431f-a254-c12054011227" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36433dd3-61aa-4f71-8b66-44e3a3dc18eb (dataset): DatasetConfig { id: 36433dd3-61aa-4f71-8b66-44e3a3dc18eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f1e79c2-3f1d-46db-b63d-aafdf556cce9 (dataset): DatasetConfig { id: 3f1e79c2-3f1d-46db-b63d-aafdf556cce9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42141d9b-3987-4f5c-8c24-1f4659f9872f (dataset): DatasetConfig { id: 42141d9b-3987-4f5c-8c24-1f4659f9872f (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 427c6398-a7da-4b1d-acb0-e25f30f9fe51 (dataset): DatasetConfig { id: 427c6398-a7da-4b1d-acb0-e25f30f9fe51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44fa0493-7884-41e9-9fab-d71cb4aa073d (dataset): DatasetConfig { id: 44fa0493-7884-41e9-9fab-d71cb4aa073d (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb670d3-d201-47e0-bf2c-8f38f3d05780 (dataset): DatasetConfig { id: 4cb670d3-d201-47e0-bf2c-8f38f3d05780 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53c35ebb-0d73-41b2-9561-a15f8b67dcae (dataset): DatasetConfig { id: 53c35ebb-0d73-41b2-9561-a15f8b67dcae (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56766a84-c6ae-42aa-afef-55f582a3b8a8 (dataset): DatasetConfig { id: 56766a84-c6ae-42aa-afef-55f582a3b8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58d3aed7-2df8-4740-b87f-263704edbfc0 (dataset): DatasetConfig { id: 58d3aed7-2df8-4740-b87f-263704edbfc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bb3c770-9e11-4ddf-96ab-03bdf308bdd3 (dataset): DatasetConfig { id: 5bb3c770-9e11-4ddf-96ab-03bdf308bdd3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dfd37ef-0864-402a-808b-b85aa5733df0 (dataset): DatasetConfig { id: 5dfd37ef-0864-402a-808b-b85aa5733df0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e451c3c-6833-4c67-838b-68fe4958bde8 (dataset): DatasetConfig { id: 5e451c3c-6833-4c67-838b-68fe4958bde8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 60da44b8-e68d-4bd8-b84b-51e9f0ecf81d (dataset): DatasetConfig { id: 60da44b8-e68d-4bd8-b84b-51e9f0ecf81d (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682f85c9-838f-4c73-bc19-72cabf0d52fa (dataset): DatasetConfig { id: 682f85c9-838f-4c73-bc19-72cabf0d52fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68962ef6-7667-4667-a947-0fbc8307e3d6 (dataset): DatasetConfig { id: 68962ef6-7667-4667-a947-0fbc8307e3d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b86b897-b948-49a2-9083-3bc8995d6a34 (dataset): DatasetConfig { id: 6b86b897-b948-49a2-9083-3bc8995d6a34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c7e9517-0eb0-4ce1-bf1a-a8436db25444 (dataset): DatasetConfig { id: 6c7e9517-0eb0-4ce1-bf1a-a8436db25444 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 714f0434-6b5f-4ff7-ae1c-f930ccbf8a86 (dataset): DatasetConfig { id: 714f0434-6b5f-4ff7-ae1c-f930ccbf8a86 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 78ec0266-a2b7-4fc5-bdf3-c931aa2d5c3f (dataset): DatasetConfig { id: 78ec0266-a2b7-4fc5-bdf3-c931aa2d5c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a3bfd07-014f-42c4-b3b4-c6b37e08a2b9 (dataset): DatasetConfig { id: 7a3bfd07-014f-42c4-b3b4-c6b37e08a2b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d55379c-24ea-4536-9b49-420b016c416d (dataset): DatasetConfig { id: 7d55379c-24ea-4536-9b49-420b016c416d (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f29e21e-ecf6-41fd-81d4-846c7e12b66f (dataset): DatasetConfig { id: 7f29e21e-ecf6-41fd-81d4-846c7e12b66f (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8395e8ae-9a4c-4122-ad95-2ccb695ec51e (dataset): DatasetConfig { id: 8395e8ae-9a4c-4122-ad95-2ccb695ec51e (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84034e90-423b-4cac-bacd-7fb9b1c00a75 (dataset): DatasetConfig { id: 84034e90-423b-4cac-bacd-7fb9b1c00a75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8529136c-9cab-4e4a-ad54-836c54027ec7 (dataset): DatasetConfig { id: 8529136c-9cab-4e4a-ad54-836c54027ec7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87a40811-b89b-4ccf-b3fb-269fcf935246 (dataset): DatasetConfig { id: 87a40811-b89b-4ccf-b3fb-269fcf935246 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8823b9d4-1bf1-4a02-be53-d99a453917f9 (dataset): DatasetConfig { id: 8823b9d4-1bf1-4a02-be53-d99a453917f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fc1ca0c-4433-440a-b119-9160346e95b2 (dataset): DatasetConfig { id: 8fc1ca0c-4433-440a-b119-9160346e95b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 954ea72a-635f-4830-a58d-f4a11672d397 (dataset): DatasetConfig { id: 954ea72a-635f-4830-a58d-f4a11672d397 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60a6873-4480-4e51-bc87-20efe7df451a (dataset): DatasetConfig { id: a60a6873-4480-4e51-bc87-20efe7df451a (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acd69e56-d29c-4e4b-a631-bc8eb032a28c (dataset): DatasetConfig { id: acd69e56-d29c-4e4b-a631-bc8eb032a28c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4ea59d1-10a3-4ef7-ac09-7cea0b8a899f (dataset): DatasetConfig { id: b4ea59d1-10a3-4ef7-ac09-7cea0b8a899f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc59c38-17da-4d0a-9ce9-621338256386 (dataset): DatasetConfig { id: bbc59c38-17da-4d0a-9ce9-621338256386 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbc93aa8-fa04-48c0-a3a8-d10d68cc1df6 (dataset): DatasetConfig { id: bbc93aa8-fa04-48c0-a3a8-d10d68cc1df6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c2aa7faf-0077-4e9f-b32d-2ec1eef906f4 (dataset): DatasetConfig { id: c2aa7faf-0077-4e9f-b32d-2ec1eef906f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c80cb4f0-064a-453e-8ad9-93c32ebf1501 (dataset): DatasetConfig { id: c80cb4f0-064a-453e-8ad9-93c32ebf1501 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb60b20c-4c2a-46a7-86ca-e1a94ca0b0d1 (dataset): DatasetConfig { id: cb60b20c-4c2a-46a7-86ca-e1a94ca0b0d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbec95b9-6fc9-4696-bdd9-8b81f8430fdb (dataset): DatasetConfig { id: cbec95b9-6fc9-4696-bdd9-8b81f8430fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ccb4f561-9ab1-4899-9039-b5e8a59258fb (dataset): DatasetConfig { id: ccb4f561-9ab1-4899-9039-b5e8a59258fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0fcf9c0-6534-4b9e-bb3e-06fd0b5be508 (dataset): DatasetConfig { id: d0fcf9c0-6534-4b9e-bb3e-06fd0b5be508 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d22ba6f3-3aeb-429a-bb71-23dbac833350 (dataset): DatasetConfig { id: d22ba6f3-3aeb-429a-bb71-23dbac833350 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d88866b0-3721-4e68-a6b8-82c09a004546 (dataset): DatasetConfig { id: d88866b0-3721-4e68-a6b8-82c09a004546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db7287b2-ed47-41c6-bd4e-6371ee0a397c (dataset): DatasetConfig { id: db7287b2-ed47-41c6-bd4e-6371ee0a397c (dataset), name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dedf2353-00e8-4a09-b596-ef831dfa4191 (dataset): DatasetConfig { id: dedf2353-00e8-4a09-b596-ef831dfa4191 (dataset), name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5626b61-df7d-40e3-b6e5-26a231201fa8 (dataset): DatasetConfig { id: e5626b61-df7d-40e3-b6e5-26a231201fa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ea6bdb0c-3dc6-4269-82d2-325bd3a8aa89 (dataset): DatasetConfig { id: ea6bdb0c-3dc6-4269-82d2-325bd3a8aa89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eade0d13-3570-4293-84dd-40701c3cbf59 (dataset): DatasetConfig { id: eade0d13-3570-4293-84dd-40701c3cbf59 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f456411e-9796-4c86-8d06-b512177419db (dataset): DatasetConfig { id: f456411e-9796-4c86-8d06-b512177419db (dataset), name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7e0bd23-1b17-4eba-96ad-182152ab0fd4 (dataset): DatasetConfig { id: f7e0bd23-1b17-4eba-96ad-182152ab0fd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f841da3f-9368-4aac-83e7-b50e165ac912 (dataset): DatasetConfig { id: f841da3f-9368-4aac-83e7-b50e165ac912 (dataset), name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f8ae4024-96d3-4898-87a3-c3ca60255f99 (dataset): DatasetConfig { id: f8ae4024-96d3-4898-87a3-c3ca60255f99 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff6c3aa5-7939-4c0d-961c-91e3bd0f9f19 (dataset): DatasetConfig { id: ff6c3aa5-7939-4c0d-961c-91e3bd0f9f19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4372025-03-04T05:56:43.470ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4382025-03-04T05:56:43.470ZINFOSledAgent (StorageManager): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-04T05:56:43.470ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4402025-03-04T05:56:43.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4412025-03-04T05:56:43.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4422025-03-04T05:56:43.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f" } file = sled-storage/src/manager.rs:1433
4432025-03-04T05:56:43.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4442025-03-04T05:56:43.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4452025-03-04T05:56:43.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crucible" } file = sled-storage/src/manager.rs:1433
4462025-03-04T05:56:43.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4472025-03-04T05:56:43.592ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4482025-03-04T05:56:43.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75" } file = sled-storage/src/manager.rs:1433
4492025-03-04T05:56:43.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4502025-03-04T05:56:43.652ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4512025-03-04T05:56:43.652ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6" } file = sled-storage/src/manager.rs:1433
4522025-03-04T05:56:43.710ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4532025-03-04T05:56:43.710ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4542025-03-04T05:56:43.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone"), full_name: "oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone" } file = sled-storage/src/manager.rs:1433
4552025-03-04T05:56:43.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4562025-03-04T05:56:43.738ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4572025-03-04T05:56:43.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone/oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456"), full_name: "oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone/oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456" } file = sled-storage/src/manager.rs:1433
4582025-03-04T05:56:43.781ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
4592025-03-04T05:56:43.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4602025-03-04T05:56:43.797ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4612025-03-04T05:56:43.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da" } file = sled-storage/src/manager.rs:1433
4622025-03-04T05:56:43.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4632025-03-04T05:56:43.858ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4642025-03-04T05:56:43.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crucible" } file = sled-storage/src/manager.rs:1433
4652025-03-04T05:56:43.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4662025-03-04T05:56:43.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4672025-03-04T05:56:43.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f" } file = sled-storage/src/manager.rs:1433
4682025-03-04T05:56:43.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4692025-03-04T05:56:43.964ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4702025-03-04T05:56:43.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/862379c5-061f-49d2-8232-148b101e17d0/crypt/zone/oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/zone/oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422" } file = sled-storage/src/manager.rs:1433
4712025-03-04T05:56:44.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-04T05:56:44.021ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4732025-03-04T05:56:44.021ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
4742025-03-04T05:56:44.070ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-04T05:56:44.070ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4762025-03-04T05:56:44.070ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone" } file = sled-storage/src/manager.rs:1433
4772025-03-04T05:56:44.099ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-04T05:56:44.099ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4792025-03-04T05:56:44.099ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/debug"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/debug" } file = sled-storage/src/manager.rs:1433
4802025-03-04T05:56:44.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4812025-03-04T05:56:44.128ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4822025-03-04T05:56:44.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_crucible_b378c03c-e24e-431f-a254-c12054011227"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_crucible_b378c03c-e24e-431f-a254-c12054011227" } file = sled-storage/src/manager.rs:1433
4832025-03-04T05:56:44.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4842025-03-04T05:56:44.186ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4852025-03-04T05:56:44.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/debug"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/debug" } file = sled-storage/src/manager.rs:1433
4862025-03-04T05:56:44.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-04T05:56:44.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4882025-03-04T05:56:44.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4892025-03-04T05:56:44.262ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-04T05:56:44.262ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4912025-03-04T05:56:44.262ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4922025-03-04T05:56:44.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-04T05:56:44.310ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4942025-03-04T05:56:44.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4952025-03-04T05:56:44.360ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-04T05:56:44.360ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4972025-03-04T05:56:44.360ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crucible" } file = sled-storage/src/manager.rs:1433
4982025-03-04T05:56:44.410ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4992025-03-04T05:56:44.410ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5002025-03-04T05:56:44.410ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone" } file = sled-storage/src/manager.rs:1433
5012025-03-04T05:56:44.439ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5022025-03-04T05:56:44.439ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5032025-03-04T05:56:44.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5042025-03-04T05:56:44.488ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5052025-03-04T05:56:44.488ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5062025-03-04T05:56:44.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5072025-03-04T05:56:44.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5082025-03-04T05:56:44.536ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5092025-03-04T05:56:44.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/clickhouse" } file = sled-storage/src/manager.rs:1433
5102025-03-04T05:56:44.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5112025-03-04T05:56:44.588ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5122025-03-04T05:56:44.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d" } file = sled-storage/src/manager.rs:1433
5132025-03-04T05:56:44.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5142025-03-04T05:56:44.648ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5152025-03-04T05:56:44.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone" } file = sled-storage/src/manager.rs:1433
5162025-03-04T05:56:44.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5172025-03-04T05:56:44.677ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5182025-03-04T05:56:44.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/debug"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/debug" } file = sled-storage/src/manager.rs:1433
5192025-03-04T05:56:44.706ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5202025-03-04T05:56:44.706ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5212025-03-04T05:56:44.706ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c" } file = sled-storage/src/manager.rs:1433
5222025-03-04T05:56:44.746ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 15.997271004s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
5232025-03-04T05:56:44.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5242025-03-04T05:56:44.765ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5252025-03-04T05:56:44.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crucible" } file = sled-storage/src/manager.rs:1433
5262025-03-04T05:56:44.782ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
5272025-03-04T05:56:44.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5282025-03-04T05:56:44.813ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5292025-03-04T05:56:44.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5" } file = sled-storage/src/manager.rs:1433
5302025-03-04T05:56:44.870ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5312025-03-04T05:56:44.870ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5322025-03-04T05:56:44.870ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone/oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f" } file = sled-storage/src/manager.rs:1433
5332025-03-04T05:56:44.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5342025-03-04T05:56:44.929ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5352025-03-04T05:56:44.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e" } file = sled-storage/src/manager.rs:1433
5362025-03-04T05:56:44.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5372025-03-04T05:56:44.991ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5382025-03-04T05:56:44.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/debug"), full_name: "oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/debug" } file = sled-storage/src/manager.rs:1433
5392025-03-04T05:56:45.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5402025-03-04T05:56:45.021ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5412025-03-04T05:56:45.021ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/zone"), full_name: "oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/zone" } file = sled-storage/src/manager.rs:1433
5422025-03-04T05:56:45.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5432025-03-04T05:56:45.050ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5442025-03-04T05:56:45.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e" } file = sled-storage/src/manager.rs:1433
5452025-03-04T05:56:45.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5462025-03-04T05:56:45.108ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5472025-03-04T05:56:45.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b" } file = sled-storage/src/manager.rs:1433
5482025-03-04T05:56:45.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5492025-03-04T05:56:45.171ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5502025-03-04T05:56:45.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/debug"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/debug" } file = sled-storage/src/manager.rs:1433
5512025-03-04T05:56:45.200ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5522025-03-04T05:56:45.200ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5532025-03-04T05:56:45.200ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crucible" } file = sled-storage/src/manager.rs:1433
5542025-03-04T05:56:45.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5552025-03-04T05:56:45.248ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5562025-03-04T05:56:45.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone"), full_name: "oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/zone" } file = sled-storage/src/manager.rs:1433
5572025-03-04T05:56:45.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5582025-03-04T05:56:45.276ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5592025-03-04T05:56:45.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec" } file = sled-storage/src/manager.rs:1433
5602025-03-04T05:56:45.335ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5612025-03-04T05:56:45.335ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5622025-03-04T05:56:45.335ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/862379c5-061f-49d2-8232-148b101e17d0/crypt/zone"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/zone" } file = sled-storage/src/manager.rs:1433
5632025-03-04T05:56:45.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5642025-03-04T05:56:45.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5652025-03-04T05:56:45.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1" } file = sled-storage/src/manager.rs:1433
5662025-03-04T05:56:45.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5672025-03-04T05:56:45.424ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5682025-03-04T05:56:45.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/zone/oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936" } file = sled-storage/src/manager.rs:1433
5692025-03-04T05:56:45.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5702025-03-04T05:56:45.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5712025-03-04T05:56:45.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba" } file = sled-storage/src/manager.rs:1433
5722025-03-04T05:56:45.545ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5732025-03-04T05:56:45.545ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5742025-03-04T05:56:45.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/zone/oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1"), full_name: "oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/zone/oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1" } file = sled-storage/src/manager.rs:1433
5752025-03-04T05:56:45.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5762025-03-04T05:56:45.603ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5772025-03-04T05:56:45.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5782025-03-04T05:56:45.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5792025-03-04T05:56:45.652ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5802025-03-04T05:56:45.652ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
5812025-03-04T05:56:45.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5822025-03-04T05:56:45.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5832025-03-04T05:56:45.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone/oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091" } file = sled-storage/src/manager.rs:1433
5842025-03-04T05:56:45.762ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5852025-03-04T05:56:45.762ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5862025-03-04T05:56:45.762ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/debug"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/debug" } file = sled-storage/src/manager.rs:1433
5872025-03-04T05:56:45.785ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
5882025-03-04T05:56:45.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5892025-03-04T05:56:45.791ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5902025-03-04T05:56:45.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0" } file = sled-storage/src/manager.rs:1433
5912025-03-04T05:56:45.850ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5922025-03-04T05:56:45.850ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5932025-03-04T05:56:45.850ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/zone" } file = sled-storage/src/manager.rs:1433
5942025-03-04T05:56:45.879ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5952025-03-04T05:56:45.879ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5962025-03-04T05:56:45.879ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crucible" } file = sled-storage/src/manager.rs:1433
5972025-03-04T05:56:45.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5982025-03-04T05:56:45.926ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5992025-03-04T05:56:45.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6002025-03-04T05:56:45.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6012025-03-04T05:56:45.976ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6022025-03-04T05:56:45.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/862379c5-061f-49d2-8232-148b101e17d0/crypt/zone/oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/zone/oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba" } file = sled-storage/src/manager.rs:1433
6032025-03-04T05:56:46.036ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6042025-03-04T05:56:46.036ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6052025-03-04T05:56:46.036ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone/oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e"), full_name: "oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/zone/oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e" } file = sled-storage/src/manager.rs:1433
6062025-03-04T05:56:46.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6072025-03-04T05:56:46.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6082025-03-04T05:56:46.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/zone/oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935" } file = sled-storage/src/manager.rs:1433
6092025-03-04T05:56:46.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6102025-03-04T05:56:46.155ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6112025-03-04T05:56:46.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/debug"), full_name: "oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/debug" } file = sled-storage/src/manager.rs:1433
6122025-03-04T05:56:46.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6132025-03-04T05:56:46.185ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6142025-03-04T05:56:46.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6152025-03-04T05:56:46.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6162025-03-04T05:56:46.235ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6172025-03-04T05:56:46.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crucible" } file = sled-storage/src/manager.rs:1433
6182025-03-04T05:56:46.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6192025-03-04T05:56:46.283ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6202025-03-04T05:56:46.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/debug"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/debug" } file = sled-storage/src/manager.rs:1433
6212025-03-04T05:56:46.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6222025-03-04T05:56:46.313ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6232025-03-04T05:56:46.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb" } file = sled-storage/src/manager.rs:1433
6242025-03-04T05:56:46.373ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6252025-03-04T05:56:46.373ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6262025-03-04T05:56:46.373ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone/oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6" } file = sled-storage/src/manager.rs:1433
6272025-03-04T05:56:46.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6282025-03-04T05:56:46.433ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6292025-03-04T05:56:46.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crucible" } file = sled-storage/src/manager.rs:1433
6302025-03-04T05:56:46.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6312025-03-04T05:56:46.482ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6322025-03-04T05:56:46.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crucible" } file = sled-storage/src/manager.rs:1433
6332025-03-04T05:56:46.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6342025-03-04T05:56:46.530ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6352025-03-04T05:56:46.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/862379c5-061f-49d2-8232-148b101e17d0/crypt/debug"), full_name: "oxp_862379c5-061f-49d2-8232-148b101e17d0/crypt/debug" } file = sled-storage/src/manager.rs:1433
6362025-03-04T05:56:46.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6372025-03-04T05:56:46.559ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6382025-03-04T05:56:46.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone"), full_name: "oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/zone" } file = sled-storage/src/manager.rs:1433
6392025-03-04T05:56:46.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6402025-03-04T05:56:46.587ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6412025-03-04T05:56:46.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526"), full_name: "oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/zone/oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526" } file = sled-storage/src/manager.rs:1433
6422025-03-04T05:56:46.647ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6432025-03-04T05:56:46.648ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6442025-03-04T05:56:46.648ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
6452025-03-04T05:56:46.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3178663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53704 req_id = 0f86ef8f-233d-47a1-92e2-9beafd316159 response_code = 200 uri = /datasets
6462025-03-04T05:56:46.680ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eaf13922-18b0-451a-b875-f259d011b935 (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4438f5c4-a905-4be1-b8b5-ec11f87dbf6f (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
6472025-03-04T05:56:46.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46228
6482025-03-04T05:56:46.680ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6492025-03-04T05:56:46.680ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502025-03-04T05:56:46.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6512025-03-04T05:56:46.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-03-04T05:56:46.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6532025-03-04T05:56:46.698ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542025-03-04T05:56:46.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6552025-03-04T05:56:46.706ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:186
6562025-03-04T05:56:46.707ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:186
6572025-03-04T05:56:46.707ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6582025-03-04T05:56:46.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6592025-03-04T05:56:46.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6602025-03-04T05:56:46.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-03-04T05:56:46.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-03-04T05:56:46.789ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
6632025-03-04T05:56:46.803ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 file = illumos-utils/src/zone.rs:327
6642025-03-04T05:56:46.806ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935 file = illumos-utils/src/zone.rs:327
6652025-03-04T05:56:46.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f file = illumos-utils/src/zone.rs:327
6662025-03-04T05:56:46.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 file = illumos-utils/src/zone.rs:365
6672025-03-04T05:56:46.828ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935 file = illumos-utils/src/zone.rs:365
6682025-03-04T05:56:46.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f file = illumos-utils/src/zone.rs:365
6692025-03-04T05:56:47.790ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/probe_manager.rs:234 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
6702025-03-04T05:56:48.533ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6712025-03-04T05:56:49.015ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6722025-03-04T05:56:49.015ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
6732025-03-04T05:56:49.498ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6742025-03-04T05:56:49.498ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
6752025-03-04T05:56:49.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 44.391635ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
6762025-03-04T05:56:49.510ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
6772025-03-04T05:56:49.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 90.200384ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
6782025-03-04T05:56:49.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 28.059611ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
6792025-03-04T05:56:49.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 49.952823ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
6802025-03-04T05:56:49.654ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5267213232217957198 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
6812025-03-04T05:56:49.654ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11118190841367288472 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
6822025-03-04T05:56:49.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 140.304462ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
6832025-03-04T05:56:49.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 277.354554ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
6842025-03-04T05:56:49.687ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4367
6852025-03-04T05:56:49.687ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4377 gateway = fd00:1122:3344:101::1
6862025-03-04T05:56:49.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 63.998665ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
6872025-03-04T05:56:49.696ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4391 gateway = fd00:1122:3344:101::1
6882025-03-04T05:56:49.696ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4456
6892025-03-04T05:56:49.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 235.631327ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
6902025-03-04T05:56:49.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 283.83578ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
6912025-03-04T05:56:49.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 377.683719ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
6922025-03-04T05:56:50.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 293.158497ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
6932025-03-04T05:56:50.083ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4497
6942025-03-04T05:56:50.083ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4530
6952025-03-04T05:56:50.161ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 355.114698ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
6962025-03-04T05:56:50.189ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4543
6972025-03-04T05:56:50.189ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4408
6982025-03-04T05:56:50.257ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4450
6992025-03-04T05:56:50.257ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4507 rack_subnet = fd00:1122:3344::
7002025-03-04T05:56:50.279ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4518
7012025-03-04T05:56:50.279ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4600
7022025-03-04T05:56:50.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 813.736117ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7032025-03-04T05:56:50.368ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4632
7042025-03-04T05:56:50.368ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4638
7052025-03-04T05:56:50.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 845.881823ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
7062025-03-04T05:56:50.468ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4679
7072025-03-04T05:56:50.468ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4549
7082025-03-04T05:56:50.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 837.642563ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7092025-03-04T05:56:50.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10081812616642580904 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
7102025-03-04T05:56:50.570ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7483247701201380882 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
7112025-03-04T05:56:50.591ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4582
7122025-03-04T05:56:50.591ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7132025-03-04T05:56:50.627ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dbce58b0-062a-4b73-bfbe-866ce6aaea71) file = sled-agent/src/nexus.rs:530 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
7142025-03-04T05:56:50.628ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7152025-03-04T05:56:50.660ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7162025-03-04T05:56:50.660ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7172025-03-04T05:56:50.661ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7182025-03-04T05:56:50.661ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7192025-03-04T05:56:50.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
7202025-03-04T05:56:50.751ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7212025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7222025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7242025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7262025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7282025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7302025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7322025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7342025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7362025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7382025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7402025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7422025-03-04T05:56:50.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-03-04T05:56:51.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 586.647348ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7442025-03-04T05:56:51.230ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 1.40862293s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
7452025-03-04T05:56:51.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 545.792178ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7462025-03-04T05:56:51.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 775.911109ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7472025-03-04T05:56:51.932ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 1.240862471s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7482025-03-04T05:56:52.566ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 911.61474ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7492025-03-04T05:56:52.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 1.344105861s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
7502025-03-04T05:56:53.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 540.800365ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7512025-03-04T05:56:53.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935") failed: Property not found. retry in 865.125195ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7522025-03-04T05:56:53.731ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6") failed: Property not found. retry in 1.118565608s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7532025-03-04T05:56:54.001ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f") failed: Property not found. retry in 813.893318ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
7542025-03-04T05:56:54.868ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6
7552025-03-04T05:56:54.868ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_eaf13922-18b0-451a-b875-f259d011b935
7562025-03-04T05:56:54.868ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_4438f5c4-a905-4be1-b8b5-ec11f87dbf6f
7572025-03-04T05:56:54.868ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7582025-03-04T05:56:54.868ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
7592025-03-04T05:56:54.868ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7602025-03-04T05:56:54.868ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
7612025-03-04T05:56:54.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8188238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46228 req_id = 0b7f1efb-c388-4044-8d25-7bca834d0020 response_code = 204 uri = /omicron-zones
7622025-03-04T05:56:54.869ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
7632025-03-04T05:56:54.870ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7642025-03-04T05:56:56.051ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7652025-03-04T05:56:56.099ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7662025-03-04T05:56:56.147ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:761
7672025-03-04T05:56:56.147ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7682025-03-04T05:56:56.179ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7692025-03-04T05:56:56.180ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7702025-03-04T05:56:56.180ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7712025-03-04T05:56:56.209ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eaf13922-18b0-451a-b875-f259d011b935 (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4438f5c4-a905-4be1-b8b5-ec11f87dbf6f (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 (service), filesystem_pool: Some(ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 203c511a-5ebd-49f6-8579-2d735ceaf5e7, kind: Service { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 }, name: Name("ntp-c1664764-3c59-428c-a5ce-b06638e2a7a5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 42])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
7722025-03-04T05:56:56.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33901
7732025-03-04T05:56:56.209ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7742025-03-04T05:56:56.209ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7752025-03-04T05:56:56.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7762025-03-04T05:56:56.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7772025-03-04T05:56:56.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-03-04T05:56:56.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-03-04T05:56:56.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7802025-03-04T05:56:56.241ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
7812025-03-04T05:56:56.241ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
7822025-03-04T05:56:56.241ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7832025-03-04T05:56:56.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-03-04T05:56:56.252ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7852025-03-04T05:56:56.285ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7862025-03-04T05:56:56.285ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7872025-03-04T05:56:56.285ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7882025-03-04T05:56:56.315ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 156, 42]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7892025-03-04T05:56:56.315ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = boundary_ntp
7902025-03-04T05:56:56.315ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7912025-03-04T05:56:56.316ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7922025-03-04T05:56:56.316ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7932025-03-04T05:56:56.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942025-03-04T05:56:56.341ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5 file = illumos-utils/src/zone.rs:327
7952025-03-04T05:56:56.357ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5 file = illumos-utils/src/zone.rs:365
7962025-03-04T05:56:57.100ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7972025-03-04T05:56:57.101ZINFOSledAgent (ServiceManager): Booting oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
7982025-03-04T05:56:57.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 39.973975ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
7992025-03-04T05:56:57.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 101.940623ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8002025-03-04T05:56:57.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 174.918513ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8012025-03-04T05:56:57.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 572.810932ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8022025-03-04T05:56:58.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 929.58721ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8032025-03-04T05:56:59.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 1.394124968s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8042025-03-04T05:56:59.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5267213232217957198 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8052025-03-04T05:56:59.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11118190841367288472 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8062025-03-04T05:57:00.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 1.144308722s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8072025-03-04T05:57:00.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10081812616642580904 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8082025-03-04T05:57:00.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7483247701201380882 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8092025-03-04T05:57:01.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5") failed: Property not found. retry in 795.454625ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8102025-03-04T05:57:02.473ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5
8112025-03-04T05:57:02.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8122025-03-04T05:57:02.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8132025-03-04T05:57:02.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6264351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33901 req_id = 22255100-2553-411c-a2a1-3ad92573125d response_code = 204 uri = /omicron-zones
8142025-03-04T05:57:02.476ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:802
8152025-03-04T05:57:02.505ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8162025-03-04T05:57:02.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56211
8172025-03-04T05:57:02.514ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8182025-03-04T05:57:02.514ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56211 req_id = 1917f73c-c594-4a3c-8e3e-485319b08cc6 response_code = 500 uri = /timesync
8192025-03-04T05:57:02.516ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8202025-03-04T05:57:02.630ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8212025-03-04T05:57:02.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35541
8222025-03-04T05:57:04.376ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8785888030490782461 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8232025-03-04T05:57:04.839ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4167208150616129549 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8242025-03-04T05:57:04.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2506773972565945454 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8252025-03-04T05:57:06.638ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8262025-03-04T05:57:06.638ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4007867 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35541 req_id = 56931c1a-b2e5-4515-98fb-d60fef0f58b3 response_code = 500 uri = /timesync
8272025-03-04T05:57:06.640ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8282025-03-04T05:57:06.785ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8292025-03-04T05:57:06.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44059
8302025-03-04T05:57:06.794ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8312025-03-04T05:57:06.794ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44059 req_id = e91ae40d-68d5-4895-8867-c5de5bd203a7 response_code = 500 uri = /timesync
8322025-03-04T05:57:06.797ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8332025-03-04T05:57:06.925ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8342025-03-04T05:57:06.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37258
8352025-03-04T05:57:09.659ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5267213232217957198 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8362025-03-04T05:57:09.659ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11118190841367288472 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8372025-03-04T05:57:10.431ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10081812616642580904 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8382025-03-04T05:57:10.431ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7483247701201380882 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8392025-03-04T05:57:10.792ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c1664764-3c59-428c-a5ce-b06638e2a7a5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8402025-03-04T05:57:10.792ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37258 req_id = b39db475-737d-4d18-9f67-3a1f26a08dc0 response_code = 500 uri = /timesync
8412025-03-04T05:57:10.794ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8422025-03-04T05:57:11.033ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8432025-03-04T05:57:11.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40601
8442025-03-04T05:57:11.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40601 req_id = 7ee519e2-6b5f-4b85-8dd2-af7e1797f150 response_code = 200 uri = /timesync
8452025-03-04T05:57:11.046ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.003042619 } file = sled-agent/src/rack_setup/service.rs:810
8462025-03-04T05:57:11.046ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8472025-03-04T05:57:11.345ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8482025-03-04T05:57:11.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46255
8492025-03-04T05:57:11.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46255 req_id = 3276091a-c45c-43cb-b762-5ab0848c3c75 response_code = 200 uri = /timesync
8502025-03-04T05:57:11.356ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.002915055 } file = sled-agent/src/rack_setup/service.rs:810
8512025-03-04T05:57:11.356ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8522025-03-04T05:57:11.614ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8532025-03-04T05:57:11.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57143
8542025-03-04T05:57:11.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9070 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57143 req_id = 85238c18-1deb-4533-83b2-2c1544ebc7af response_code = 200 uri = /timesync
8552025-03-04T05:57:11.626ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.002805004 } file = sled-agent/src/rack_setup/service.rs:810
8562025-03-04T05:57:11.626ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8572025-03-04T05:57:11.815ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8582025-03-04T05:57:11.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61577
8592025-03-04T05:57:11.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8525 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61577 req_id = 3783ddb7-c9d8-43cb-b013-1f71b6e03ebd response_code = 200 uri = /timesync
8602025-03-04T05:57:11.826ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.000522755 } file = sled-agent/src/rack_setup/service.rs:810
8612025-03-04T05:57:11.826ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8622025-03-04T05:57:12.124ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8632025-03-04T05:57:12.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63677
8642025-03-04T05:57:12.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8501 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63677 req_id = 5a1caed8-c4e4-49d3-a33a-72dc4f698cf2 response_code = 200 uri = /timesync
8652025-03-04T05:57:12.135ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.000518908 } file = sled-agent/src/rack_setup/service.rs:810
8662025-03-04T05:57:12.135ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8672025-03-04T05:57:12.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14903417816002154631 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8682025-03-04T05:57:12.334ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15595980665192765530 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8692025-03-04T05:57:12.732ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8702025-03-04T05:57:12.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39997
8712025-03-04T05:57:12.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8783 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39997 req_id = 1cca5700-20cf-4838-9fc3-94a8ae2fc6d5 response_code = 200 uri = /timesync
8722025-03-04T05:57:12.743ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.000511344 } file = sled-agent/src/rack_setup/service.rs:810
8732025-03-04T05:57:12.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8742025-03-04T05:57:13.359ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8752025-03-04T05:57:13.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46340
8762025-03-04T05:57:13.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46340 req_id = 61dfc154-f5e8-4ca2-b4b4-345a669796ec response_code = 200 uri = /timesync
8772025-03-04T05:57:13.370ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741067831.886043, correction: 0.0019453 } file = sled-agent/src/rack_setup/service.rs:810
8782025-03-04T05:57:13.370ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8792025-03-04T05:57:14.192ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8802025-03-04T05:57:14.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37061
8812025-03-04T05:57:14.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8521 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37061 req_id = 8a85a520-def5-43f8-b8f6-40ecda12ab94 response_code = 200 uri = /timesync
8822025-03-04T05:57:14.203ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741067831.886043, correction: 0.001201056 } file = sled-agent/src/rack_setup/service.rs:810
8832025-03-04T05:57:14.203ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8842025-03-04T05:57:14.235ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8785888030490782461 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8852025-03-04T05:57:14.700ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4167208150616129549 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8862025-03-04T05:57:14.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2506773972565945454 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8872025-03-04T05:57:15.330ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8882025-03-04T05:57:15.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55845
8892025-03-04T05:57:15.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8932 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55845 req_id = 3b6a52d8-8bdf-41ac-a277-ebe1b41f9769 response_code = 200 uri = /timesync
8902025-03-04T05:57:15.341ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741067831.886043, correction: 0.001019775 } file = sled-agent/src/rack_setup/service.rs:810
8912025-03-04T05:57:15.341ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8922025-03-04T05:57:15.638ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 179.935993ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
8932025-03-04T05:57:16.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8942025-03-04T05:57:16.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59882
8952025-03-04T05:57:16.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 20913 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59882 req_id = 56358f14-37b6-4a49-8462-9a539b55da1f response_code = 200 uri = /timesync
8962025-03-04T05:57:16.378ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2429174486, ip_addr: 144.202.66.214, stratum: 4, ref_time: 1741067835.2196417, correction: 0.000430735 } file = sled-agent/src/rack_setup/service.rs:810
8972025-03-04T05:57:16.378ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1445
8982025-03-04T05:57:16.407ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eaf13922-18b0-451a-b875-f259d011b935 (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4438f5c4-a905-4be1-b8b5-ec11f87dbf6f (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 (service), filesystem_pool: Some(ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 203c511a-5ebd-49f6-8579-2d735ceaf5e7, kind: Service { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 }, name: Name("ntp-c1664764-3c59-428c-a5ce-b06638e2a7a5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 42])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: ff4daee7-6fc0-4fc4-8b4a-c09658e9c936 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8bb16c1e-345d-49ed-ad92-0238dd37f11b (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8d061a7b-6e1e-491e-b92b-2f88c4009c75 (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 6574c0e7-7a35-445a-b209-e0c2cf9f0eba (service), filesystem_pool: Some(ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 73be7cfc-d662-44ab-8bb1-909b83b84091 (service), filesystem_pool: Some(ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
8992025-03-04T05:57:16.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60604
9002025-03-04T05:57:16.408ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9012025-03-04T05:57:16.408ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9022025-03-04T05:57:16.419ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9032025-03-04T05:57:16.419ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9042025-03-04T05:57:16.429ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9052025-03-04T05:57:16.429ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9062025-03-04T05:57:16.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9072025-03-04T05:57:16.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082025-03-04T05:57:16.447ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9092025-03-04T05:57:16.447ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9102025-03-04T05:57:16.457ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9112025-03-04T05:57:16.457ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9122025-03-04T05:57:16.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9132025-03-04T05:57:16.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9142025-03-04T05:57:16.476ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9152025-03-04T05:57:16.476ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9162025-03-04T05:57:16.485ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172025-03-04T05:57:16.485ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
9182025-03-04T05:57:16.486ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
9192025-03-04T05:57:16.486ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9202025-03-04T05:57:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212025-03-04T05:57:16.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222025-03-04T05:57:16.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232025-03-04T05:57:16.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242025-03-04T05:57:16.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252025-03-04T05:57:16.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9262025-03-04T05:57:16.661ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b file = illumos-utils/src/zone.rs:327
9272025-03-04T05:57:16.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba file = illumos-utils/src/zone.rs:327
9282025-03-04T05:57:16.670ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091 file = illumos-utils/src/zone.rs:327
9292025-03-04T05:57:16.675ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936 file = illumos-utils/src/zone.rs:327
9302025-03-04T05:57:16.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75 file = illumos-utils/src/zone.rs:327
9312025-03-04T05:57:16.684ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b file = illumos-utils/src/zone.rs:365
9322025-03-04T05:57:16.689ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba file = illumos-utils/src/zone.rs:365
9332025-03-04T05:57:16.693ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091 file = illumos-utils/src/zone.rs:365
9342025-03-04T05:57:16.697ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936 file = illumos-utils/src/zone.rs:365
9352025-03-04T05:57:16.703ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75 file = illumos-utils/src/zone.rs:365
9362025-03-04T05:57:19.738ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='73be7cfc-d662-44ab-8bb1-909b83b84091'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372025-03-04T05:57:19.739ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6574c0e7-7a35-445a-b209-e0c2cf9f0eba'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382025-03-04T05:57:19.739ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9392025-03-04T05:57:19.744ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9402025-03-04T05:57:19.779ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8bb16c1e-345d-49ed-ad92-0238dd37f11b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412025-03-04T05:57:19.779ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9422025-03-04T05:57:19.831ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8d061a7b-6e1e-491e-b92b-2f88c4009c75'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9432025-03-04T05:57:19.831ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9442025-03-04T05:57:19.842ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ff4daee7-6fc0-4fc4-8b4a-c09658e9c936'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9452025-03-04T05:57:19.843ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9462025-03-04T05:57:19.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 45.838133ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9472025-03-04T05:57:19.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 63.137884ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9482025-03-04T05:57:19.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 63.530997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9492025-03-04T05:57:19.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 70.809988ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9502025-03-04T05:57:20.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 132.055675ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9512025-03-04T05:57:20.275ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40541
9522025-03-04T05:57:20.280ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40541 req_id = a48d0247-ab24-4525-9bf8-6c5f4a1c2af6 response_code = 200 uri = /baseboard
9532025-03-04T05:57:20.515ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 103.325922ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9542025-03-04T05:57:20.950ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 138.723893ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9552025-03-04T05:57:21.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 248.054005ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9562025-03-04T05:57:21.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 71.477687ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9572025-03-04T05:57:21.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 73.465812ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9582025-03-04T05:57:21.290ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 176.191679ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9592025-03-04T05:57:21.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 526.086447ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9602025-03-04T05:57:21.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 585.22674ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9612025-03-04T05:57:21.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 57.432266ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9622025-03-04T05:57:21.365ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 109.098497ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9632025-03-04T05:57:21.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 206.998888ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9642025-03-04T05:57:21.482ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 473.664278ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9652025-03-04T05:57:21.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 113.325701ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9662025-03-04T05:57:21.631ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 388.85931ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9672025-03-04T05:57:21.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 520.528385ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9682025-03-04T05:57:21.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 466.899547ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9692025-03-04T05:57:21.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.142000627s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9702025-03-04T05:57:21.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 1.025796789s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9712025-03-04T05:57:22.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.139020252s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9722025-03-04T05:57:22.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 459.615024ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9732025-03-04T05:57:22.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 538.016193ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9742025-03-04T05:57:22.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 526.086164ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9752025-03-04T05:57:22.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 939.283288ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9762025-03-04T05:57:23.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 855.231648ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9772025-03-04T05:57:23.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.058113002s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9782025-03-04T05:57:23.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.49013962s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9792025-03-04T05:57:23.198ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 743.352294ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9802025-03-04T05:57:23.832ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 652.784087ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9812025-03-04T05:57:23.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 901.530786ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9822025-03-04T05:57:23.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 913.413055ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9832025-03-04T05:57:24.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.24195203s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9842025-03-04T05:57:24.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.342461564s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9852025-03-04T05:57:24.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.450367581s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9862025-03-04T05:57:24.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 913.423313ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9872025-03-04T05:57:24.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.123447032s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9882025-03-04T05:57:25.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.25830712s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9892025-03-04T05:57:25.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 762.219268ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9902025-03-04T05:57:25.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.349169872s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9912025-03-04T05:57:26.006ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.435540707s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9922025-03-04T05:57:26.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 964.738681ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9932025-03-04T05:57:26.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 809.05046ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9942025-03-04T05:57:26.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.159772848s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
9952025-03-04T05:57:27.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 854.401407ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
9962025-03-04T05:57:27.204ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.379160174s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
9972025-03-04T05:57:27.319ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 1.186700412s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
9982025-03-04T05:57:27.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 512.920777ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
9992025-03-04T05:57:27.832ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 630.235121ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10002025-03-04T05:57:27.971ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 882.686467ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10012025-03-04T05:57:27.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 922.969436ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10022025-03-04T05:57:28.041ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
10032025-03-04T05:57:28.042ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
10042025-03-04T05:57:28.042ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
10052025-03-04T05:57:28.042ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
10062025-03-04T05:57:28.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.24985138s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10072025-03-04T05:57:28.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 904.27358ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10082025-03-04T05:57:28.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 531.371477ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10092025-03-04T05:57:28.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 732.492417ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10102025-03-04T05:57:28.918ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.406452342s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10112025-03-04T05:57:29.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 534.972303ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10122025-03-04T05:57:29.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 934.315018ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10132025-03-04T05:57:29.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 742.972643ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10142025-03-04T05:57:29.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.057683771s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10152025-03-04T05:57:29.730ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.208297768s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10162025-03-04T05:57:30.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.365949875s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10172025-03-04T05:57:30.356ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.208289189s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10182025-03-04T05:57:30.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 931.853548ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10192025-03-04T05:57:30.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 612.886075ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10202025-03-04T05:57:30.855ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 628.89348ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
10212025-03-04T05:57:30.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.163235649s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10222025-03-04T05:57:31.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 704.455947ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10232025-03-04T05:57:31.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 615.653132ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10242025-03-04T05:57:31.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.375868642s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10252025-03-04T05:57:31.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 542.863153ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10262025-03-04T05:57:31.992ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 942.647372ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10272025-03-04T05:57:32.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 1.107010794s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10282025-03-04T05:57:32.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.460655373s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10292025-03-04T05:57:32.263ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.014122542s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10302025-03-04T05:57:32.944ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.037552894s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10312025-03-04T05:57:32.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.060820671s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10322025-03-04T05:57:33.143ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 538.755263ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10332025-03-04T05:57:33.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.497385087s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10342025-03-04T05:57:33.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.140696685s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10352025-03-04T05:57:33.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 987.057005ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10362025-03-04T05:57:33.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 889.899407ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10372025-03-04T05:57:34.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 1.157612982s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10382025-03-04T05:57:34.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b") failed: Property not found. retry in 1.215457947s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10392025-03-04T05:57:34.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091") failed: Property not found. retry in 1.329438516s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10402025-03-04T05:57:34.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75") failed: Property not found. retry in 1.40709839s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10412025-03-04T05:57:34.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba") failed: Property not found. retry in 1.22144567s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10422025-03-04T05:57:35.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936") failed: Property not found. retry in 569.445413ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10432025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_8bb16c1e-345d-49ed-ad92-0238dd37f11b
10442025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba
10452025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_73be7cfc-d662-44ab-8bb1-909b83b84091
10462025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_ff4daee7-6fc0-4fc4-8b4a-c09658e9c936
10472025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_8d061a7b-6e1e-491e-b92b-2f88c4009c75
10482025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10492025-03-04T05:57:36.224ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10502025-03-04T05:57:36.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19815559 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60604 req_id = bb85aaa3-03ac-42a9-aa39-9ccfbcb197d9 response_code = 204 uri = /omicron-zones
10512025-03-04T05:57:36.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61896
10522025-03-04T05:57:36.296ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 38702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = b6bf8c2b-972a-4e9d-87ac-1c9386de94fe response_code = 500 uri = /cockroachdb
10532025-03-04T05:57:36.296ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b6bf8c2b-972a-4e9d-87ac-1c9386de94fe", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b6bf8c2b-972a-4e9d-87ac-1c9386de94fe" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 121.574982ms
10542025-03-04T05:57:36.448ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = 905487de-3f0d-4448-9d87-f99e3da4d959 response_code = 500 uri = /cockroachdb
10552025-03-04T05:57:36.448ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "905487de-3f0d-4448-9d87-f99e3da4d959", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "905487de-3f0d-4448-9d87-f99e3da4d959" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 134.081794ms
10562025-03-04T05:57:36.609ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25252 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = 961bf5a7-f128-433b-9307-d37a94ed49ee response_code = 500 uri = /cockroachdb
10572025-03-04T05:57:36.609ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "961bf5a7-f128-433b-9307-d37a94ed49ee", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "961bf5a7-f128-433b-9307-d37a94ed49ee" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 122.185002ms
10582025-03-04T05:57:36.760ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = 1981e5ea-5860-4976-bd93-a441c8c60546 response_code = 500 uri = /cockroachdb
10592025-03-04T05:57:36.760ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1981e5ea-5860-4976-bd93-a441c8c60546", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1981e5ea-5860-4976-bd93-a441c8c60546" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 101.973283ms
10602025-03-04T05:57:36.893ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = f1f1fe21-6ba8-4361-90a7-7bd74aad6bbb response_code = 500 uri = /cockroachdb
10612025-03-04T05:57:36.893ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f1f1fe21-6ba8-4361-90a7-7bd74aad6bbb", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f1f1fe21-6ba8-4361-90a7-7bd74aad6bbb" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 207.112532ms
10622025-03-04T05:57:37.129ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_6574c0e7-7a35-445a-b209-e0c2cf9f0eba /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = 6147fec3-4b6c-43de-870d-95b4269f2859 response_code = 500 uri = /cockroachdb
10632025-03-04T05:57:37.129ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6147fec3-4b6c-43de-870d-95b4269f2859", "content-length": "124", "date": "Tue, 04 Mar 2025 05:57:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6147fec3-4b6c-43de-870d-95b4269f2859" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 300.180877ms
10642025-03-04T05:57:37.463ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3818
10652025-03-04T05:58:01.865ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3836
10662025-03-04T05:58:08.946ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3859
10672025-03-04T05:58:08.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31515849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61896 req_id = ec32450e-fb0c-4868-9e58-0ef52826364a response_code = 204 uri = /cockroachdb
10682025-03-04T05:58:08.948ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47112
10692025-03-04T05:58:08.956ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.270636667s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
10702025-03-04T05:58:08.986ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: ebe15f2f-5599-4e56-9de2-bbb8ff6dd3a6 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: eaf13922-18b0-451a-b875-f259d011b935 (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4438f5c4-a905-4be1-b8b5-ec11f87dbf6f (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 (service), filesystem_pool: Some(ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 203c511a-5ebd-49f6-8579-2d735ceaf5e7, kind: Service { id: c1664764-3c59-428c-a5ce-b06638e2a7a5 }, name: Name("ntp-c1664764-3c59-428c-a5ce-b06638e2a7a5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 42])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: ff4daee7-6fc0-4fc4-8b4a-c09658e9c936 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8bb16c1e-345d-49ed-ad92-0238dd37f11b (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8d061a7b-6e1e-491e-b92b-2f88c4009c75 (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 6574c0e7-7a35-445a-b209-e0c2cf9f0eba (service), filesystem_pool: Some(ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 73be7cfc-d662-44ab-8bb1-909b83b84091 (service), filesystem_pool: Some(ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: facf9ba6-3984-483d-8b69-ac2385032cb0 (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 35d27072-44df-4fd6-866d-d1add136b456 (service), filesystem_pool: Some(ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba (service), filesystem_pool: Some(ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 8238b003-dedc-43e6-b34f-18d7c6f2afdb (service), filesystem_pool: Some(ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: c152d9d3-703c-4495-9e84-3c45e46c2d9e (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 81922a9f-1a1f-4a2e-88cc-9e7df0e9652d (service), filesystem_pool: Some(ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 5fc5a3c4-0609-418e-a494-7d115dd1532e (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 59e19ed2-4fc4-4d33-a663-a7426b30466f (service), filesystem_pool: Some(ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 81e095b4-2896-4ad3-9b50-f1be5c9a27da (service), filesystem_pool: Some(ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a5f9a7de-349d-449f-a55b-fb0913f87dec (service), filesystem_pool: Some(ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b378c03c-e24e-431f-a254-c12054011227 (service), filesystem_pool: Some(ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8528db78-e2f7-44c7-8d15-13bc39cb9422 (service), filesystem_pool: Some(ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2081df51-d9c7-4936-8c20-8310c69c4f6c (service), filesystem_pool: Some(ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9701a1e2-5663-47a0-8fe8-71f544503f2e (service), filesystem_pool: Some(ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: fa76994d-b4ba-4052-8deb-02dac022c1b1 (service), filesystem_pool: Some(ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b6e6a7d3-9914-4d65-8b50-5ae243cb09f6 (service), filesystem_pool: Some(ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 797bb0fd-80e0-48a6-9872-65886c524526 (service), filesystem_pool: Some(ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
10712025-03-04T05:58:08.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53049
10722025-03-04T05:58:08.988ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-03-04T05:58:08.988ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10742025-03-04T05:58:09.004ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-03-04T05:58:09.004ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10762025-03-04T05:58:09.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-03-04T05:58:09.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10782025-03-04T05:58:09.023ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-03-04T05:58:09.023ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802025-03-04T05:58:09.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-03-04T05:58:09.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10822025-03-04T05:58:09.040ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-03-04T05:58:09.040ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10842025-03-04T05:58:09.051ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-03-04T05:58:09.051ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10862025-03-04T05:58:09.060ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-03-04T05:58:09.060ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10882025-03-04T05:58:09.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10892025-03-04T05:58:09.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10902025-03-04T05:58:09.078ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10912025-03-04T05:58:09.078ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10922025-03-04T05:58:09.090ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10932025-03-04T05:58:09.090ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10942025-03-04T05:58:09.107ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10952025-03-04T05:58:09.107ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10962025-03-04T05:58:09.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10972025-03-04T05:58:09.127ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, kind: Crucible }, responder: ... }
10982025-03-04T05:58:09.136ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10992025-03-04T05:58:09.136ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11002025-03-04T05:58:09.145ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11012025-03-04T05:58:09.145ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11022025-03-04T05:58:09.155ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11032025-03-04T05:58:09.155ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11042025-03-04T05:58:09.165ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11052025-03-04T05:58:09.165ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, kind: Crucible }, responder: ... }
11062025-03-04T05:58:09.180ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11072025-03-04T05:58:09.180ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11082025-03-04T05:58:09.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11092025-03-04T05:58:09.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11102025-03-04T05:58:09.201ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11112025-03-04T05:58:09.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, kind: Crucible }, responder: ... }
11122025-03-04T05:58:09.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-03-04T05:58:09.215ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
11142025-03-04T05:58:09.215ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
11152025-03-04T05:58:09.215ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
11162025-03-04T05:58:09.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11172025-03-04T05:58:09.331ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11182025-03-04T05:58:09.360ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11192025-03-04T05:58:09.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11202025-03-04T05:58:09.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212025-03-04T05:58:09.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11222025-03-04T05:58:09.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232025-03-04T05:58:09.362ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11242025-03-04T05:58:09.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11252025-03-04T05:58:09.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262025-03-04T05:58:09.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272025-03-04T05:58:09.591ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11282025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11322025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332025-03-04T05:58:09.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342025-03-04T05:58:09.604ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11352025-03-04T05:58:09.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362025-03-04T05:58:09.604ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb file = illumos-utils/src/zone.rs:327
11372025-03-04T05:58:09.610ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e file = illumos-utils/src/zone.rs:327
11382025-03-04T05:58:09.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d file = illumos-utils/src/zone.rs:327
11392025-03-04T05:58:09.619ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e file = illumos-utils/src/zone.rs:327
11402025-03-04T05:58:09.624ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f file = illumos-utils/src/zone.rs:327
11412025-03-04T05:58:09.629ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da file = illumos-utils/src/zone.rs:327
11422025-03-04T05:58:09.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec file = illumos-utils/src/zone.rs:327
11432025-03-04T05:58:09.777ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb file = illumos-utils/src/zone.rs:365
11442025-03-04T05:58:09.782ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e file = illumos-utils/src/zone.rs:365
11452025-03-04T05:58:09.786ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d file = illumos-utils/src/zone.rs:365
11462025-03-04T05:58:09.791ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e file = illumos-utils/src/zone.rs:365
11472025-03-04T05:58:09.796ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f file = illumos-utils/src/zone.rs:365
11482025-03-04T05:58:09.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da file = illumos-utils/src/zone.rs:365
11492025-03-04T05:58:09.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec file = illumos-utils/src/zone.rs:365
11502025-03-04T05:58:09.811ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422 file = illumos-utils/src/zone.rs:327
11512025-03-04T05:58:09.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1 file = illumos-utils/src/zone.rs:327
11522025-03-04T05:58:09.821ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6 file = illumos-utils/src/zone.rs:327
11532025-03-04T05:58:09.827ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526 file = illumos-utils/src/zone.rs:327
11542025-03-04T05:58:09.832ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b378c03c-e24e-431f-a254-c12054011227 file = illumos-utils/src/zone.rs:327
11552025-03-04T05:58:09.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c file = illumos-utils/src/zone.rs:327
11562025-03-04T05:58:09.843ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e file = illumos-utils/src/zone.rs:327
11572025-03-04T05:58:09.850ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422 file = illumos-utils/src/zone.rs:365
11582025-03-04T05:58:09.858ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1 file = illumos-utils/src/zone.rs:365
11592025-03-04T05:58:09.864ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6 file = illumos-utils/src/zone.rs:365
11602025-03-04T05:58:09.870ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526 file = illumos-utils/src/zone.rs:365
11612025-03-04T05:58:09.877ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b378c03c-e24e-431f-a254-c12054011227 file = illumos-utils/src/zone.rs:365
11622025-03-04T05:58:09.886ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c file = illumos-utils/src/zone.rs:365
11632025-03-04T05:58:09.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e file = illumos-utils/src/zone.rs:365
11642025-03-04T05:58:09.974ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11652025-03-04T05:58:10.031ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11662025-03-04T05:58:10.087ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11672025-03-04T05:58:10.144ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11682025-03-04T05:58:10.200ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11692025-03-04T05:58:10.204ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11702025-03-04T05:58:10.204ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11712025-03-04T05:58:10.318ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 164, 242]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11722025-03-04T05:58:10.318ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11732025-03-04T05:58:10.320ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11742025-03-04T05:58:10.320ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11752025-03-04T05:58:10.395ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 250, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11762025-03-04T05:58:10.395ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11772025-03-04T05:58:10.397ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11782025-03-04T05:58:10.397ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11792025-03-04T05:58:10.449ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 195, 5]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11802025-03-04T05:58:10.450ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11812025-03-04T05:58:10.451ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11822025-03-04T05:58:10.451ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11832025-03-04T05:58:10.508ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 247, 9]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11842025-03-04T05:58:10.508ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11852025-03-04T05:58:10.509ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11862025-03-04T05:58:10.509ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11872025-03-04T05:58:10.562ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 142, 24]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11882025-03-04T05:58:10.562ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11892025-03-04T05:58:10.578ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11902025-03-04T05:58:10.578ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11912025-03-04T05:58:10.579ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11922025-03-04T05:58:10.579ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11932025-03-04T05:58:10.579ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11942025-03-04T05:58:10.579ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11952025-03-04T05:58:10.579ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11962025-03-04T05:58:10.580ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11972025-03-04T05:58:10.580ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11982025-03-04T05:58:10.580ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11992025-03-04T05:58:10.605ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12002025-03-04T05:58:10.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12012025-03-04T05:58:10.666ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12022025-03-04T05:58:10.670ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12032025-03-04T05:58:10.673ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12042025-03-04T05:58:10.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12052025-03-04T05:58:10.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12062025-03-04T05:58:10.676ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12072025-03-04T05:58:10.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12082025-03-04T05:58:10.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12092025-03-04T05:58:10.876ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456 file = illumos-utils/src/zone.rs:327
12102025-03-04T05:58:10.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0 file = illumos-utils/src/zone.rs:327
12112025-03-04T05:58:10.899ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f file = illumos-utils/src/zone.rs:327
12122025-03-04T05:58:10.912ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba file = illumos-utils/src/zone.rs:327
12132025-03-04T05:58:10.934ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1 file = illumos-utils/src/zone.rs:327
12142025-03-04T05:58:10.953ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456 file = illumos-utils/src/zone.rs:365
12152025-03-04T05:58:10.966ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0 file = illumos-utils/src/zone.rs:365
12162025-03-04T05:58:10.975ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f file = illumos-utils/src/zone.rs:365
12172025-03-04T05:58:10.986ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba file = illumos-utils/src/zone.rs:365
12182025-03-04T05:58:10.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1 file = illumos-utils/src/zone.rs:365
12192025-03-04T05:58:14.647ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202025-03-04T05:58:14.654ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12212025-03-04T05:58:14.654ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12222025-03-04T05:58:14.662ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12232025-03-04T05:58:14.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b378c03c-e24e-431f-a254-c12054011227: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='500a5aa1-a3d8-49ba-977c-38d2dd753c6c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242025-03-04T05:58:14.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1e1754a2-89c8-467a-88c5-d83201d02d2c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252025-03-04T05:58:14.704ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b378c03c-e24e-431f-a254-c12054011227 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12262025-03-04T05:58:14.707ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5bc5e0a-d3d8-4919-adc6-9c3f51a68886'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272025-03-04T05:58:14.708ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_862379c5-061f-49d2-8232-148b101e17d0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3b9668aa-5134-433d-9145-d8fb4b3834de'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282025-03-04T05:58:14.708ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12292025-03-04T05:58:14.714ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dd49543b-69c2-429c-b4d6-ffdaca87e128'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302025-03-04T05:58:14.715ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e1e2a450-cc41-47b3-b057-bfd20d38770e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312025-03-04T05:58:14.745ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12322025-03-04T05:58:14.771ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12332025-03-04T05:58:14.782ZINFOSledAgent (ServiceManager): Booting oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12342025-03-04T05:58:14.790ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12352025-03-04T05:58:14.849ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4694b83d-83cb-4090-b770-aea44b0da964'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362025-03-04T05:58:14.850ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12372025-03-04T05:58:15.277ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='8238b003-dedc-43e6-b34f-18d7c6f2afdb'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382025-03-04T05:58:15.278ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12392025-03-04T05:58:15.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 28.326836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12402025-03-04T05:58:15.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 68.27762ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12412025-03-04T05:58:15.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 57.971679ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12422025-03-04T05:58:15.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 42.991302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12432025-03-04T05:58:15.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 49.326226ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12442025-03-04T05:58:15.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 30.033506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12452025-03-04T05:58:15.360ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 68.522202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12462025-03-04T05:58:15.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 40.719418ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12472025-03-04T05:58:15.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 26.922018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12482025-03-04T05:58:15.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 132.122108ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12492025-03-04T05:58:15.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 129.860984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12502025-03-04T05:58:15.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 137.16628ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12512025-03-04T05:58:15.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 67.201468ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12522025-03-04T05:58:15.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 128.028323ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12532025-03-04T05:58:15.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 60.008199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12542025-03-04T05:58:15.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 77.795995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12552025-03-04T05:58:15.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 50.86185ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12562025-03-04T05:58:15.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 121.906366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12572025-03-04T05:58:15.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 145.210505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12582025-03-04T05:58:15.544ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 51.881999ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12592025-03-04T05:58:15.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 273.77338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12602025-03-04T05:58:15.573ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 172.351266ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12612025-03-04T05:58:15.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 213.448627ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12622025-03-04T05:58:15.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 257.823089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12632025-03-04T05:58:15.617ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 108.56552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12642025-03-04T05:58:15.631ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 178.863198ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12652025-03-04T05:58:15.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 84.123262ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12662025-03-04T05:58:15.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 225.591288ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12672025-03-04T05:58:15.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 267.369107ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12682025-03-04T05:58:15.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 402.266683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12692025-03-04T05:58:15.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 211.647791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12702025-03-04T05:58:15.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 202.96227ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12712025-03-04T05:58:15.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 528.45449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12722025-03-04T05:58:15.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 261.068079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12732025-03-04T05:58:15.829ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 425.133676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12742025-03-04T05:58:15.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 531.460488ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12752025-03-04T05:58:15.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 338.444511ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12762025-03-04T05:58:15.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 277.913542ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12772025-03-04T05:58:15.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 950.134871ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12782025-03-04T05:58:15.989ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 470.069649ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12792025-03-04T05:58:15.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 350.065487ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12802025-03-04T05:58:16.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 448.398184ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12812025-03-04T05:58:16.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.038155481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12822025-03-04T05:58:16.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 451.599247ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12832025-03-04T05:58:16.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 528.115557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12842025-03-04T05:58:16.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 908.015393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12852025-03-04T05:58:16.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.112153852s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12862025-03-04T05:58:16.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 923.47753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12872025-03-04T05:58:16.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 741.815767ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12882025-03-04T05:58:16.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 832.950855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12892025-03-04T05:58:18.557ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.441961052s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
12902025-03-04T05:58:18.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 827.306957ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
12912025-03-04T05:58:18.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 809.133731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
12922025-03-04T05:58:18.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 591.974336ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
12932025-03-04T05:58:18.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 830.836717ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
12942025-03-04T05:58:18.931ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.071242859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
12952025-03-04T05:58:18.947ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.473314318s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
12962025-03-04T05:58:18.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.335037679s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
12972025-03-04T05:58:19.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 1.158642543s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
12982025-03-04T05:58:19.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.380106719s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
12992025-03-04T05:58:19.125ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13002025-03-04T05:58:19.125ZINFOSledAgent (ServiceManager): Booting oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13012025-03-04T05:58:19.399ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 63.338464ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13022025-03-04T05:58:19.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 131.566437ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13032025-03-04T05:58:19.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 542.338575ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
13042025-03-04T05:58:19.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.427255291s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
13052025-03-04T05:58:19.631ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 142.698296ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13062025-03-04T05:58:19.712ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 1.451397784s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
13072025-03-04T05:58:19.808ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.401542005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
13082025-03-04T05:58:19.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 218.551743ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13092025-03-04T05:58:20.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.454173781s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
13102025-03-04T05:58:20.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 762.235981ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
13112025-03-04T05:58:20.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.277788149s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
13122025-03-04T05:58:20.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 659.022072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
13132025-03-04T05:58:20.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 997.216054ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13142025-03-04T05:58:20.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.250700063s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
13152025-03-04T05:58:20.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.474310431s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
13162025-03-04T05:58:20.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 528.737568ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
13172025-03-04T05:58:20.915ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182025-03-04T05:58:20.915ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13192025-03-04T05:58:20.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.055175757s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
13202025-03-04T05:58:20.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 951.18736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
13212025-03-04T05:58:20.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 1.055756243s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
13222025-03-04T05:58:21.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.207581449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
13232025-03-04T05:58:21.042ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9e1aa322-1d11-4a74-bafb-a3031da3340f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13242025-03-04T05:58:21.042ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13252025-03-04T05:58:21.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 1.190400779s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
13262025-03-04T05:58:21.193ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 60.938955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13272025-03-04T05:58:21.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.006051277s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
13282025-03-04T05:58:21.266ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 126.042814ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13292025-03-04T05:58:21.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 27.10199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13302025-03-04T05:58:21.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.060655377s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13312025-03-04T05:58:21.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 56.011301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13322025-03-04T05:58:21.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 126.246054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13332025-03-04T05:58:21.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 169.822558ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13342025-03-04T05:58:21.476ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352025-03-04T05:58:21.476ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13362025-03-04T05:58:21.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.223834633s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
13372025-03-04T05:58:21.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 269.031051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13382025-03-04T05:58:21.557ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.474276313s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
13392025-03-04T05:58:21.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 267.369311ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13402025-03-04T05:58:21.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.159261131s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
13412025-03-04T05:58:21.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 43.983373ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13422025-03-04T05:58:21.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 139.380976ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13432025-03-04T05:58:21.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 762.289206ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13442025-03-04T05:58:21.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 1.14427248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13452025-03-04T05:58:21.931ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.14803738s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
13462025-03-04T05:58:21.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.257533116s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
13472025-03-04T05:58:21.974ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 273.011121ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13482025-03-04T05:58:22.106ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.263560484s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
13492025-03-04T05:58:22.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 746.988793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
13502025-03-04T05:58:22.235ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 773.254292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
13512025-03-04T05:58:22.250ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 624.377385ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
13522025-03-04T05:58:22.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 421.519703ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13532025-03-04T05:58:22.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 716.411977ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
13542025-03-04T05:58:22.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 792.091752ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13552025-03-04T05:58:22.409ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1c45276e-4032-4af7-b0dd-228abf1563e5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4b7c8fba-5149-4a8b-a4a9-938f8f54582b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562025-03-04T05:58:22.409ZINFOSledAgent (ServiceManager): Booting oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13572025-03-04T05:58:22.580ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582025-03-04T05:58:22.580ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13592025-03-04T05:58:22.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 555.378998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13602025-03-04T05:58:22.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.031520689s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13612025-03-04T05:58:22.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 43.509285ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13622025-03-04T05:58:22.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.003024065s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
13632025-03-04T05:58:22.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.469581286s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
13642025-03-04T05:58:22.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 115.939451ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13652025-03-04T05:58:22.942ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.26198411s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
13662025-03-04T05:58:22.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 32.528104ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13672025-03-04T05:58:23.027ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 130.496446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13682025-03-04T05:58:23.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 666.045829ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
13692025-03-04T05:58:23.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 128.627541ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13702025-03-04T05:58:23.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 595.443256ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13712025-03-04T05:58:23.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.07628584s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
13722025-03-04T05:58:23.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.341645091s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
13732025-03-04T05:58:23.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 529.539623ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
13742025-03-04T05:58:23.195ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 612.883229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
13752025-03-04T05:58:23.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 837.184375ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13762025-03-04T05:58:23.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.265783039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
13772025-03-04T05:58:23.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 271.804134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13782025-03-04T05:58:23.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.030063926s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13792025-03-04T05:58:23.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 103.361007ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13802025-03-04T05:58:23.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.426119792s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
13812025-03-04T05:58:23.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 226.593213ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13822025-03-04T05:58:23.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 924.520565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
13832025-03-04T05:58:23.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.414189532s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
13842025-03-04T05:58:23.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 772.35919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
13852025-03-04T05:58:23.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.07393636s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
13862025-03-04T05:58:23.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 708.744384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13872025-03-04T05:58:23.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.436923351s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
13882025-03-04T05:58:23.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.017915902s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
13892025-03-04T05:58:23.818ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 919.706566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
13902025-03-04T05:58:24.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 1.319987302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
13912025-03-04T05:58:24.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.488514017s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
13922025-03-04T05:58:24.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.34894434s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
13932025-03-04T05:58:24.282ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 527.061607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
13942025-03-04T05:58:24.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.325729949s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
13952025-03-04T05:58:24.485ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 544.738417ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
13962025-03-04T05:58:24.487ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13972025-03-04T05:58:24.488ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
13982025-03-04T05:58:24.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.183875449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
13992025-03-04T05:58:24.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 810.712764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
14002025-03-04T05:58:24.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 605.110969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14012025-03-04T05:58:24.621ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 1.413625625s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
14022025-03-04T05:58:24.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 780.570236ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14032025-03-04T05:58:24.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 538.365565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
14042025-03-04T05:58:24.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.478952905s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
14052025-03-04T05:58:24.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.488711356s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
14062025-03-04T05:58:24.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.0021459s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14072025-03-04T05:58:24.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 63.974911ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14082025-03-04T05:58:25.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 1.087613942s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
14092025-03-04T05:58:25.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 94.155584ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14102025-03-04T05:58:25.168ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.153645076s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14112025-03-04T05:58:25.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 270.254275ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14122025-03-04T05:58:25.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.220511939s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
14132025-03-04T05:58:25.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 1.067097025s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14142025-03-04T05:58:25.379ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.256888264s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
14152025-03-04T05:58:25.398ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.769526291s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
14162025-03-04T05:58:25.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 592.866278ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
14172025-03-04T05:58:25.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 1.339153804s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
14182025-03-04T05:58:25.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 298.952583ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14192025-03-04T05:58:25.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 809.98773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14202025-03-04T05:58:25.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.494445675s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
14212025-03-04T05:58:25.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.00682198s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
14222025-03-04T05:58:25.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 937.633897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
14232025-03-04T05:58:25.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 821.645224ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
14242025-03-04T05:58:25.801ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 630.081972ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14252025-03-04T05:58:25.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 1.37691446s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14262025-03-04T05:58:26.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 520.28218ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
14272025-03-04T05:58:26.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 701.163765ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
14282025-03-04T05:58:26.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 1.115665932s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
14292025-03-04T05:58:26.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 606.740938ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
14302025-03-04T05:58:26.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 503.118207ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14312025-03-04T05:58:26.364ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 840.527196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14322025-03-04T05:58:26.379ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 942.036269ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
14332025-03-04T05:58:26.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 999.376741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14342025-03-04T05:58:26.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 696.467903ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14352025-03-04T05:58:26.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.218059207s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
14362025-03-04T05:58:26.482ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14372025-03-04T05:58:26.482ZINFOSledAgent (ServiceManager): Booting oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14382025-03-04T05:58:26.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.461603137s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
14392025-03-04T05:58:26.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 927.566757ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
14402025-03-04T05:58:26.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 894.618323ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
14412025-03-04T05:58:26.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 771.890809ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
14422025-03-04T05:58:26.733ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.316459703s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
14432025-03-04T05:58:26.754ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 60.375369ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14442025-03-04T05:58:26.771ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 1.472883576s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
14452025-03-04T05:58:26.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 793.500449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
14462025-03-04T05:58:26.827ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 115.665041ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14472025-03-04T05:58:26.868ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 886.230794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14482025-03-04T05:58:27.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 533.405718ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
14492025-03-04T05:58:27.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 198.508684ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14502025-03-04T05:58:27.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.328754388s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14512025-03-04T05:58:27.168ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 782.574682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
14522025-03-04T05:58:27.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 505.050658ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14532025-03-04T05:58:27.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 667.28397ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
14542025-03-04T05:58:27.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 634.124915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14552025-03-04T05:58:27.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.367298045s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
14562025-03-04T05:58:27.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 517.195021ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14572025-03-04T05:58:27.409ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 869.580334ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14582025-03-04T05:58:27.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 791.594465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
14592025-03-04T05:58:27.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 761.453125ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
14602025-03-04T05:58:27.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 895.195788ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
14612025-03-04T05:58:27.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 665.038003ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
14622025-03-04T05:58:27.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.090883039s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
14632025-03-04T05:58:27.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 581.391787ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
14642025-03-04T05:58:27.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 541.630733ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14652025-03-04T05:58:27.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 996.612971ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14662025-03-04T05:58:27.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 518.902318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14672025-03-04T05:58:27.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 533.476653ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14682025-03-04T05:58:27.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.087604062s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
14692025-03-04T05:58:27.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 663.064589ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
14702025-03-04T05:58:28.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.467299868s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
14712025-03-04T05:58:28.042ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
14722025-03-04T05:58:28.054ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
14732025-03-04T05:58:28.055ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
14742025-03-04T05:58:28.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.119343343s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
14752025-03-04T05:58:28.068ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
14762025-03-04T05:58:28.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 1.096525209s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
14772025-03-04T05:58:28.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 664.651622ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
14782025-03-04T05:58:28.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 903.084109ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
14792025-03-04T05:58:28.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.18179495s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
14802025-03-04T05:58:28.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 879.168548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14812025-03-04T05:58:28.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 519.681884ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14822025-03-04T05:58:28.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.468676179s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
14832025-03-04T05:58:28.425ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 836.042186ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14842025-03-04T05:58:28.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.091459814s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
14852025-03-04T05:58:28.494ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 558.113614ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14862025-03-04T05:58:28.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.046339594s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
14872025-03-04T05:58:28.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 875.607656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
14882025-03-04T05:58:28.714ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.338306045s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
14892025-03-04T05:58:28.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 1.219772413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
14902025-03-04T05:58:28.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.11652202s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
14912025-03-04T05:58:28.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.196666767s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
14922025-03-04T05:58:28.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.231738183s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
14932025-03-04T05:58:29.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.355212462s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
14942025-03-04T05:58:29.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 817.256011ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
14952025-03-04T05:58:29.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 1.103718299s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
14962025-03-04T05:58:29.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 1.294674487s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
14972025-03-04T05:58:29.230ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 546.708986ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
14982025-03-04T05:58:29.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 967.79094ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
14992025-03-04T05:58:29.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 502.820965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
15002025-03-04T05:58:29.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 572.061979ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
15012025-03-04T05:58:29.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f") failed: Property not found. retry in 1.247696792s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
15022025-03-04T05:58:29.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 573.767703ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
15032025-03-04T05:58:29.571ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.045549859s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15042025-03-04T05:58:29.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.336282935s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
15052025-03-04T05:58:29.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456") failed: Property not found. retry in 1.27889341s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
15062025-03-04T05:58:29.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 523.274402ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
15072025-03-04T05:58:29.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 616.011062ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
15082025-03-04T05:58:29.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 892.474972ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
15092025-03-04T05:58:29.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb") failed: Property not found. retry in 1.285673592s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
15102025-03-04T05:58:30.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 1.300908805s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
15112025-03-04T05:58:30.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 981.090762ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
15122025-03-04T05:58:30.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e") failed: Property not found. retry in 1.02619396s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
15132025-03-04T05:58:30.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 887.919192ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
15142025-03-04T05:58:30.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 1.475477664s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
15152025-03-04T05:58:30.142ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15162025-03-04T05:58:30.142ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15172025-03-04T05:58:30.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.317716531s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
15182025-03-04T05:58:30.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 1.381195384s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15192025-03-04T05:58:30.327ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d") failed: Property not found. retry in 1.206553157s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
15202025-03-04T05:58:30.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.162232814s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
15212025-03-04T05:58:30.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 27.732375ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15222025-03-04T05:58:30.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1") failed: Property not found. retry in 1.397355085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
15232025-03-04T05:58:30.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 73.148725ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15242025-03-04T05:58:30.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b378c03c-e24e-431f-a254-c12054011227") failed: Property not found. retry in 667.527365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
15252025-03-04T05:58:30.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 267.403906ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15262025-03-04T05:58:30.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e") failed: Property not found. retry in 906.709276ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
15272025-03-04T05:58:30.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.38783236s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15282025-03-04T05:58:30.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526") failed: Property not found. retry in 500.616376ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
15292025-03-04T05:58:30.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 584.162428ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15302025-03-04T05:58:30.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c") failed: Property not found. retry in 1.166704165s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
15312025-03-04T05:58:31.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0") failed: Property not found. retry in 1.055337815s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
15322025-03-04T05:58:31.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.357269908s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
15332025-03-04T05:58:31.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 707.923562ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
15342025-03-04T05:58:31.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 572.537641ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15352025-03-04T05:58:31.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6") failed: Property not found. retry in 1.44868532s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
15362025-03-04T05:58:31.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422") failed: Property not found. retry in 1.444632792s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
15372025-03-04T05:58:31.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec") failed: Property not found. retry in 720.516352ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
15382025-03-04T05:58:31.721ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 575.177164ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15392025-03-04T05:58:32.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 761.468721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
15402025-03-04T05:58:32.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 829.378173ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15412025-03-04T05:58:32.198ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 864.457736ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15422025-03-04T05:58:32.326ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 1.488645322s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15432025-03-04T05:58:32.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba") failed: Property not found. retry in 1.489378447s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
15442025-03-04T05:58:32.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da") failed: Property not found. retry in 1.409915118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
15452025-03-04T05:58:33.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 877.104288ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15462025-03-04T05:58:33.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.019881835s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15472025-03-04T05:58:33.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 1.072433979s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15482025-03-04T05:58:33.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 1.273466038s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15492025-03-04T05:58:34.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 1.407181934s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15502025-03-04T05:58:34.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 1.393070842s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15512025-03-04T05:58:35.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 1.462508119s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15522025-03-04T05:58:35.466ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52906
15532025-03-04T05:58:35.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2090 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52906 req_id = 896b8f77-b6a2-45c7-a0bf-44a3fb3741dc response_code = 200 uri = /baseboard
15542025-03-04T05:58:35.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f") failed: Property not found. retry in 949.782232ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15552025-03-04T05:58:36.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1") failed: Property not found. retry in 1.468546142s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15562025-03-04T05:58:36.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 1.490332201s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15572025-03-04T05:58:38.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 853.881616ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15582025-03-04T05:58:39.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e") failed: Property not found. retry in 913.906577ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15592025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_facf9ba6-3984-483d-8b69-ac2385032cb0
15602025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_oximeter_8238b003-dedc-43e6-b34f-18d7c6f2afdb
15612025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_clickhouse_c152d9d3-703c-4495-9e84-3c45e46c2d9e
15622025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_81922a9f-1a1f-4a2e-88cc-9e7df0e9652d
15632025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_5fc5a3c4-0609-418e-a494-7d115dd1532e
15642025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_de220f6c-b61b-4a8b-8e87-8ebeb727960f
15652025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_3fe4ab68-bcba-4043-bde2-b3e8e1f013ba
15662025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_59e19ed2-4fc4-4d33-a663-a7426b30466f
15672025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_81e095b4-2896-4ad3-9b50-f1be5c9a27da
15682025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_a5f9a7de-349d-449f-a55b-fb0913f87dec
15692025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_8528db78-e2f7-44c7-8d15-13bc39cb9422
15702025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_fa76994d-b4ba-4052-8deb-02dac022c1b1
15712025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_b6e6a7d3-9914-4d65-8b50-5ae243cb09f6
15722025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_797bb0fd-80e0-48a6-9872-65886c524526
15732025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_b378c03c-e24e-431f-a254-c12054011227
15742025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_2081df51-d9c7-4936-8c20-8310c69c4f6c
15752025-03-04T05:58:39.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_24f19fe8-afd8-4186-82ba-c991c9622aa1
15762025-03-04T05:58:39.982ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_9701a1e2-5663-47a0-8fe8-71f544503f2e
15772025-03-04T05:58:39.982ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_35d27072-44df-4fd6-866d-d1add136b456
15782025-03-04T05:58:39.983ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
15792025-03-04T05:58:39.994ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
15802025-03-04T05:58:39.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31011305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53049 req_id = ff8cef19-409d-42f3-be88-23f557910767 response_code = 204 uri = /omicron-zones
15812025-03-04T05:58:40.037ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1468
15822025-03-04T05:58:40.086ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:857
15832025-03-04T05:58:40.113ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:870
15842025-03-04T05:58:40.145ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1070
15852025-03-04T05:58:40.197ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15862025-03-04T05:58:40.302ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15872025-03-04T05:58:40.390ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15882025-03-04T05:58:40.488ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15892025-03-04T05:58:40.623ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15902025-03-04T05:58:40.880ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15912025-03-04T05:58:41.072ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15922025-03-04T05:58:41.275ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15932025-03-04T05:58:41.535ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15942025-03-04T05:58:42.033ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15952025-03-04T05:58:42.722ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15962025-03-04T05:58:43.229ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.868430558s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
15972025-03-04T05:58:43.507ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
15982025-03-04T05:58:45.526ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e84910b1-4045-46fc-a33a-87ff3aa70d25", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb\"", request_id: "e84910b1-4045-46fc-a33a-87ff3aa70d25" } file = sled-agent/src/rack_setup/service.rs:1132
15992025-03-04T05:58:48.054ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d119aeef-301d-48a8-8c61-4b80159d147f", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb\"", request_id: "d119aeef-301d-48a8-8c61-4b80159d147f" } file = sled-agent/src/rack_setup/service.rs:1132
16002025-03-04T05:58:48.933ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f6435f6c-4ec6-4f97-bb8b-a0fd4c2a99e0", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d3abd685-a2c6-4ac5-8fc7-0c8f287d81bb\"", request_id: "f6435f6c-4ec6-4f97-bb8b-a0fd4c2a99e0" } file = sled-agent/src/rack_setup/service.rs:1132
16012025-03-04T05:58:52.216ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "47dc3966-aa4c-4c39-b45f-08c59d5ec4e8", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "47dc3966-aa4c-4c39-b45f-08c59d5ec4e8" } file = sled-agent/src/rack_setup/service.rs:1132
16022025-03-04T05:58:54.461ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "10681dd6-b169-41dc-9e3c-0cd09164d325", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "10681dd6-b169-41dc-9e3c-0cd09164d325" } file = sled-agent/src/rack_setup/service.rs:1132
16032025-03-04T05:58:56.159ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "12cbe574-808d-4680-91ec-fea5bf0a2f81", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "12cbe574-808d-4680-91ec-fea5bf0a2f81" } file = sled-agent/src/rack_setup/service.rs:1132
16042025-03-04T05:58:59.302ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "db0086b0-9f7d-49f5-aa9e-fe06fb910a1d", "content-length": "173", "date": "Tue, 04 Mar 2025 05:58:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "db0086b0-9f7d-49f5-aa9e-fe06fb910a1d" } file = sled-agent/src/rack_setup/service.rs:1132
16052025-03-04T05:59:02.354ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4130e4c6-7acb-47db-b480-7638b0272350", "content-length": "173", "date": "Tue, 04 Mar 2025 05:59:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "4130e4c6-7acb-47db-b480-7638b0272350" } file = sled-agent/src/rack_setup/service.rs:1132
16062025-03-04T05:59:05.506ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58163
16072025-03-04T05:59:05.507ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58163 req_id = 7939498f-dc99-4d18-8991-e34a86583053 response_code = 200 uri = /baseboard
16082025-03-04T05:59:06.235ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b1d29f0d-7656-410b-9219-5d2431beca12", "content-length": "173", "date": "Tue, 04 Mar 2025 05:59:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "b1d29f0d-7656-410b-9219-5d2431beca12" } file = sled-agent/src/rack_setup/service.rs:1132
16092025-03-04T05:59:11.442ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8c08ce0f-276f-443d-b14c-76afe25806a0", "content-length": "173", "date": "Tue, 04 Mar 2025 05:59:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dbce58b0-062a-4b73-bfbe-866ce6aaea71\"", request_id: "8c08ce0f-276f-443d-b14c-76afe25806a0" } file = sled-agent/src/rack_setup/service.rs:1132
16102025-03-04T05:59:12.809ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
16112025-03-04T05:59:13.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52801
16122025-03-04T05:59:13.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16132025-03-04T05:59:13.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16142025-03-04T05:59:13.060ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
16152025-03-04T05:59:13.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
16162025-03-04T05:59:13.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16172025-03-04T05:59:13.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1c45276e-4032-4af7-b0dd-228abf1563e5
16182025-03-04T05:59:13.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16192025-03-04T05:59:13.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1
16202025-03-04T05:59:13.124ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16212025-03-04T05:59:13.124ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8
16222025-03-04T05:59:13.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16232025-03-04T05:59:13.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0
16242025-03-04T05:59:13.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16252025-03-04T05:59:13.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b
16262025-03-04T05:59:13.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16272025-03-04T05:59:13.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b
16282025-03-04T05:59:13.214ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16292025-03-04T05:59:13.214ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_862379c5-061f-49d2-8232-148b101e17d0
16302025-03-04T05:59:13.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312025-03-04T05:59:13.234ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f
16322025-03-04T05:59:13.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332025-03-04T05:59:13.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1
16342025-03-04T05:59:13.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52801 req_id = e1c88f94-7821-402b-863d-515047a69c26 response_code = 200 uri = /inventory
16352025-03-04T05:59:18.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49025
16362025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16372025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16382025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16392025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16402025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16412025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16422025-03-04T05:59:18.222ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16432025-03-04T05:59:18.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2956 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49025 req_id = 9120694d-7181-4c51-a825-6b958f4a3983 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16442025-03-04T05:59:18.223ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1142
16452025-03-04T05:59:18.226ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
16462025-03-04T05:59:18.228ZINFOSledAgent (RSS): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
16472025-03-04T05:59:18.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55287
16482025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16492025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16502025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16512025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16522025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16532025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16542025-03-04T05:59:18.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16552025-03-04T05:59:18.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55287 req_id = e1880cea-9acf-429c-97ff-5f6ef7685f3a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16562025-03-04T05:59:18.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48814
16572025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16582025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16592025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16602025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16612025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16632025-03-04T05:59:18.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16642025-03-04T05:59:18.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48814 req_id = 9577f773-b00f-4dd7-bdb9-9546f48e31b8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16652025-03-04T05:59:18.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54162
16662025-03-04T05:59:18.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16672025-03-04T05:59:18.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16682025-03-04T05:59:18.591ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
16692025-03-04T05:59:18.591ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
16702025-03-04T05:59:18.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16712025-03-04T05:59:18.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1c45276e-4032-4af7-b0dd-228abf1563e5
16722025-03-04T05:59:18.629ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16732025-03-04T05:59:18.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1
16742025-03-04T05:59:18.657ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16752025-03-04T05:59:18.657ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8
16762025-03-04T05:59:18.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16772025-03-04T05:59:18.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0
16782025-03-04T05:59:18.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16792025-03-04T05:59:18.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b
16802025-03-04T05:59:18.724ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16812025-03-04T05:59:18.724ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b
16822025-03-04T05:59:18.743ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16832025-03-04T05:59:18.743ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_862379c5-061f-49d2-8232-148b101e17d0
16842025-03-04T05:59:18.765ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16852025-03-04T05:59:18.765ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f
16862025-03-04T05:59:18.787ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16872025-03-04T05:59:18.787ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1
16882025-03-04T05:59:18.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208907 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54162 req_id = 8e455edf-318d-4ff4-8fc3-a565bd104e38 response_code = 200 uri = /inventory
16892025-03-04T05:59:19.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50685
16902025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16912025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16922025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16932025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962025-03-04T05:59:19.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972025-03-04T05:59:19.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50685 req_id = 0b96ff73-4947-4da4-95fa-f1ff29dc4ade response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16982025-03-04T05:59:19.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38301
16992025-03-04T05:59:19.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38301 req_id = e90b09bb-82a9-4d6d-a4bb-e794f11bb631 response_code = 200 uri = /vpc-routes
17002025-03-04T05:59:20.140ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17012025-03-04T05:59:20.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38301 req_id = e7d9b5a3-606f-48db-a261-779cd42447e9 response_code = 204 uri = /eip-gateways
17022025-03-04T05:59:20.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43381
17032025-03-04T05:59:20.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43381 req_id = b51dc677-3d89-4e38-a4a8-123ca820eb44 response_code = 200 uri = /v2p
17042025-03-04T05:59:20.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56050
17052025-03-04T05:59:20.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56050 req_id = befca471-df0a-4722-9d01-b9fa1962c0c0 response_code = 200 uri = /vpc-routes
17062025-03-04T05:59:20.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33382
17072025-03-04T05:59:20.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33382 req_id = 4bbdb0ce-1219-4949-a67c-fab138b59961 response_code = 200 uri = /v2p
17082025-03-04T05:59:20.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55529
17092025-03-04T05:59:20.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17102025-03-04T05:59:20.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17112025-03-04T05:59:20.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55529 req_id = ce048e0d-6bdd-408f-8906-605bd309e8c5 response_code = 204 uri = /switch-ports
17122025-03-04T05:59:20.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17132025-03-04T05:59:20.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56050 req_id = 518c5e96-e1e9-4aa1-a90c-fb6d86a413a5 response_code = 204 uri = /eip-gateways
17142025-03-04T05:59:20.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3989 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38301 req_id = 0ffbaf42-14a1-475b-92bd-1c17ee7aa697 response_code = 204 uri = /vpc-routes
17152025-03-04T05:59:20.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55529 req_id = 8239fcb4-f0ef-4781-ab5b-472490b0c82a response_code = 200 uri = /network-bootstore-config
17162025-03-04T05:59:20.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35071
17172025-03-04T05:59:20.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17182025-03-04T05:59:20.777ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17192025-03-04T05:59:20.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35071 req_id = 7108f008-0f36-4a6e-8ee7-6efd9985e378 response_code = 204 uri = /switch-ports
17202025-03-04T05:59:20.859ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17212025-03-04T05:59:20.859ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
17222025-03-04T05:59:20.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40067
17232025-03-04T05:59:20.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40067 req_id = 62d828ce-a4e8-4091-a7d4-5ae29be79ac7 response_code = 200 uri = /vpc-routes
17242025-03-04T05:59:20.864ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
17252025-03-04T05:59:20.866ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17262025-03-04T05:59:20.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10559 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55529 req_id = 7bed93c0-856e-4ce2-9d7c-7e1b47b4e079 response_code = 204 uri = /network-bootstore-config
17272025-03-04T05:59:20.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35071 req_id = 112a9ce3-2a10-4ab2-8d5b-a86832a4dc37 response_code = 200 uri = /network-bootstore-config
17282025-03-04T05:59:20.995ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17292025-03-04T05:59:20.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56050 req_id = a7afd511-d16d-4e0f-ab6f-376e839a2771 response_code = 204 uri = /vpc-routes
17302025-03-04T05:59:21.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60860
17312025-03-04T05:59:21.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17322025-03-04T05:59:21.103ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17332025-03-04T05:59:21.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60860 req_id = 868a4e12-2704-4473-8720-8aa146c8eb2f response_code = 204 uri = /switch-ports
17342025-03-04T05:59:21.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17352025-03-04T05:59:21.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40067 req_id = 336bda45-903b-4d67-83e8-0740f7bf308e response_code = 204 uri = /eip-gateways
17362025-03-04T05:59:21.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60860 req_id = d4835d73-d831-46d1-a0a0-0d8556c5ec71 response_code = 200 uri = /network-bootstore-config
17372025-03-04T05:59:21.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41890
17382025-03-04T05:59:21.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41890 req_id = 50c5d84d-b4d9-43dd-902b-b272b14a4786 response_code = 200 uri = /v2p
17392025-03-04T05:59:21.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40067 req_id = c0635fc5-8d60-4f3b-a2ab-77293f7edd0c response_code = 204 uri = /vpc-routes
17402025-03-04T05:59:25.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36090
17412025-03-04T05:59:25.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36090 req_id = f499efb0-7fc2-49b6-8ec7-86f726385d63 response_code = 200 uri = /vpc-routes
17422025-03-04T05:59:25.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17432025-03-04T05:59:25.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36090 req_id = 1059a6c1-038e-46cd-8f2c-38eee4c77ff5 response_code = 204 uri = /eip-gateways
17442025-03-04T05:59:25.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36090 req_id = 0499f3ce-f4d7-42dd-a8c9-e7db6bd1464c response_code = 204 uri = /vpc-routes
17452025-03-04T05:59:28.042ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
17462025-03-04T05:59:28.042ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
17472025-03-04T05:59:28.042ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
17482025-03-04T05:59:28.043ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
17492025-03-04T05:59:30.246ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:64530 remote_addr = [fd00:1122:3344:101::d]:48281 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
17502025-03-04T05:59:30.270ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 24273 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 5be0baee-b9af-46c6-8b2f-85754d506256 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
17512025-03-04T05:59:35.541ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63915
17522025-03-04T05:59:35.541ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63915 req_id = 8ef0b365-86ea-4357-b801-adb7b050453d response_code = 200 uri = /baseboard
17532025-03-04T05:59:50.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61278
17542025-03-04T05:59:50.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61278 req_id = e553a5f8-66b5-4db0-8bbc-fde3d59bd27f response_code = 200 uri = /v2p
17552025-03-04T05:59:50.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46956
17562025-03-04T05:59:50.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46956 req_id = 8765f540-7621-408a-a7ea-116b84b2809b response_code = 200 uri = /vpc-routes
17572025-03-04T05:59:50.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17582025-03-04T05:59:50.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46956 req_id = 9a91c344-a8a9-45df-8227-170a0abf6191 response_code = 204 uri = /eip-gateways
17592025-03-04T05:59:50.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46956 req_id = b5f5ac7a-b170-41fd-bd68-136b6522b924 response_code = 204 uri = /vpc-routes
17602025-03-04T05:59:50.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63596
17612025-03-04T05:59:50.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17622025-03-04T05:59:50.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17632025-03-04T05:59:50.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63596 req_id = fb24c5e2-5259-4e15-b4a7-e23106b74afe response_code = 204 uri = /switch-ports
17642025-03-04T05:59:50.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63596 req_id = a54080c3-21c0-4818-a7fc-7191cb57fc73 response_code = 200 uri = /network-bootstore-config
17652025-03-04T05:59:50.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58789
17662025-03-04T05:59:50.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58789 req_id = 641752b8-f99e-46ee-91a4-c901be09870d response_code = 200 uri = /vpc-routes
17672025-03-04T05:59:50.566ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17682025-03-04T05:59:50.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58789 req_id = 2377324a-01fe-40cf-a624-07eb0cea420c response_code = 204 uri = /eip-gateways
17692025-03-04T05:59:50.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58789 req_id = 7663a68f-20af-4bc4-93cb-42b2f19f8530 response_code = 204 uri = /vpc-routes
17702025-03-04T05:59:50.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54674
17712025-03-04T05:59:50.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54674 req_id = b8e09931-cf52-456d-95ac-ccdc6126fe08 response_code = 200 uri = /v2p
17722025-03-04T05:59:50.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59560
17732025-03-04T05:59:50.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59560 req_id = 6792f29c-3ff8-4d96-9f38-dfe8ba158f6a response_code = 200 uri = /vpc-routes
17742025-03-04T05:59:50.857ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17752025-03-04T05:59:50.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59560 req_id = 7e434869-1564-4b2d-b2d6-89b59fe2fa70 response_code = 204 uri = /eip-gateways
17762025-03-04T05:59:50.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43528
17772025-03-04T05:59:50.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17782025-03-04T05:59:50.895ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17792025-03-04T05:59:50.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43528 req_id = 961203d4-3b72-43bc-a302-6eca938140e1 response_code = 204 uri = /switch-ports
17802025-03-04T05:59:50.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43528 req_id = cee14d30-451b-4e38-85cb-21c1b8e43998 response_code = 200 uri = /network-bootstore-config
17812025-03-04T05:59:51.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37955
17822025-03-04T05:59:51.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37955 req_id = 4aa496b9-211a-4217-a335-838c48378b5b response_code = 200 uri = /v2p
17832025-03-04T05:59:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59560 req_id = 5655e0cc-450c-43b7-9660-19a65183ad27 response_code = 204 uri = /vpc-routes
17842025-03-04T05:59:51.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50334
17852025-03-04T05:59:51.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
17862025-03-04T05:59:51.103ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
17872025-03-04T05:59:51.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50334 req_id = 2ac04b42-3338-4681-976c-335479f722d8 response_code = 204 uri = /switch-ports
17882025-03-04T05:59:51.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50334 req_id = 37046693-b1ef-4013-94c3-27cf3c4b4329 response_code = 200 uri = /network-bootstore-config
17892025-03-04T06:00:00.252ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7084 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 5b40321d-34a5-490a-9605-f7b2ff6de007 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
17902025-03-04T06:00:05.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33721
17912025-03-04T06:00:05.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33721 req_id = 1408a376-39af-441c-9c9e-3db759f4e3a1 response_code = 200 uri = /baseboard
17922025-03-04T06:00:20.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33720
17932025-03-04T06:00:20.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33720 req_id = 75244cca-b7d0-42e1-a07b-3471ed2c9d0a response_code = 200 uri = /vpc-routes
17942025-03-04T06:00:20.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
17952025-03-04T06:00:20.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33720 req_id = 2d6b8572-28c5-4964-8456-9f5a0f41d47a response_code = 204 uri = /eip-gateways
17962025-03-04T06:00:20.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33720 req_id = 188fe4da-37f4-4df6-9341-9ea1e68b7633 response_code = 204 uri = /vpc-routes
17972025-03-04T06:00:20.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58540
17982025-03-04T06:00:20.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58540 req_id = e5ace18a-9610-4af7-9e84-b77b25e8404a response_code = 200 uri = /v2p
17992025-03-04T06:00:20.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39123
18002025-03-04T06:00:20.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18012025-03-04T06:00:20.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18022025-03-04T06:00:20.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39123 req_id = 2044f9e5-5be0-49d1-8620-95d158296cb6 response_code = 204 uri = /switch-ports
18032025-03-04T06:00:20.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39123 req_id = 6d15304a-0337-4bfb-8b30-0a6aedfd6d85 response_code = 200 uri = /network-bootstore-config
18042025-03-04T06:00:20.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42581
18052025-03-04T06:00:20.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42581 req_id = 78038da8-8714-43f4-a622-489293b70f21 response_code = 200 uri = /vpc-routes
18062025-03-04T06:00:20.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18072025-03-04T06:00:20.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42581 req_id = 54cb7b5d-755e-4361-86f7-4e032e6f462b response_code = 204 uri = /eip-gateways
18082025-03-04T06:00:20.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42581 req_id = e6b14e42-6f6e-476e-98d0-eed507b32179 response_code = 204 uri = /vpc-routes
18092025-03-04T06:00:20.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58567
18102025-03-04T06:00:20.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58567 req_id = a056e352-eaae-4a0a-a9a8-415fb8dcd515 response_code = 200 uri = /v2p
18112025-03-04T06:00:20.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34716
18122025-03-04T06:00:20.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18132025-03-04T06:00:20.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18142025-03-04T06:00:20.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34716 req_id = 2e803896-dbc3-43ef-b505-f1bd601b4759 response_code = 204 uri = /switch-ports
18152025-03-04T06:00:20.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40909
18162025-03-04T06:00:20.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34716 req_id = f384ac85-fade-4e05-b027-2a64960e51cc response_code = 200 uri = /network-bootstore-config
18172025-03-04T06:00:20.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40909 req_id = 2de6fdd2-c70a-40ed-be66-d9aaec14f0c8 response_code = 200 uri = /vpc-routes
18182025-03-04T06:00:20.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62703
18192025-03-04T06:00:20.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62703 req_id = aabc503a-97ce-42c8-b790-484088d843bf response_code = 200 uri = /v2p
18202025-03-04T06:00:20.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18212025-03-04T06:00:20.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40909 req_id = 7e18d38b-dabd-45a6-baf2-3f2dcc0cb314 response_code = 204 uri = /eip-gateways
18222025-03-04T06:00:20.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40909 req_id = 65794407-42f6-4b29-8b87-2af82eeba57e response_code = 204 uri = /vpc-routes
18232025-03-04T06:00:20.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40693
18242025-03-04T06:00:20.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18252025-03-04T06:00:21.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18262025-03-04T06:00:21.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40693 req_id = 1e8b45b2-93ef-4057-9ca8-e70cb6478020 response_code = 204 uri = /switch-ports
18272025-03-04T06:00:21.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40693 req_id = 9f1668c0-6191-4d3f-a131-dd99b454ac03 response_code = 200 uri = /network-bootstore-config
18282025-03-04T06:00:28.042ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
18292025-03-04T06:00:28.043ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
18302025-03-04T06:00:28.043ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
18312025-03-04T06:00:28.043ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
18322025-03-04T06:00:30.252ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6566 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 21a05163-1617-483f-b035-8e5c2765ca7b response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
18332025-03-04T06:00:35.611ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57929
18342025-03-04T06:00:35.612ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57929 req_id = 79217041-2eb0-4029-860b-718d61018e2a response_code = 200 uri = /baseboard
18352025-03-04T06:00:50.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41020
18362025-03-04T06:00:50.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41020 req_id = 4b3c6e0e-db07-4e59-be41-07744b01362c response_code = 200 uri = /vpc-routes
18372025-03-04T06:00:50.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18382025-03-04T06:00:50.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41020 req_id = 73bf684a-d833-4e7b-bf07-16ac78829a40 response_code = 204 uri = /eip-gateways
18392025-03-04T06:00:50.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43581
18402025-03-04T06:00:50.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43581 req_id = 1467c633-743a-40b4-aa52-eb11adaa4fff response_code = 200 uri = /v2p
18412025-03-04T06:00:50.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41020 req_id = efeadc5b-6120-4fab-9832-5aea06b176e4 response_code = 204 uri = /vpc-routes
18422025-03-04T06:00:50.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55404
18432025-03-04T06:00:50.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18442025-03-04T06:00:50.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18452025-03-04T06:00:50.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55404 req_id = 585115a5-3205-4734-a940-20bc5764951d response_code = 204 uri = /switch-ports
18462025-03-04T06:00:50.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55404 req_id = b8351b0f-3f6a-4cbc-91a1-c84dc74c1bbc response_code = 200 uri = /network-bootstore-config
18472025-03-04T06:00:50.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58176
18482025-03-04T06:00:50.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58176 req_id = c287d143-891a-4990-982b-032be431c95b response_code = 200 uri = /vpc-routes
18492025-03-04T06:00:50.730ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18502025-03-04T06:00:50.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58176 req_id = 26d63207-5aef-4076-9eb9-e7b79c5c8763 response_code = 204 uri = /eip-gateways
18512025-03-04T06:00:50.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58176 req_id = 17ae2c98-3982-47e3-8d7b-d36080306654 response_code = 204 uri = /vpc-routes
18522025-03-04T06:00:50.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52136
18532025-03-04T06:00:50.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52136 req_id = 260f7dfb-4c00-4edc-b9db-6f1ff552f74e response_code = 200 uri = /v2p
18542025-03-04T06:00:50.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49655
18552025-03-04T06:00:50.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18562025-03-04T06:00:50.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18572025-03-04T06:00:50.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49655 req_id = 64eced12-c1c9-4e18-b560-fb42dcdeb199 response_code = 204 uri = /switch-ports
18582025-03-04T06:00:50.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46783
18592025-03-04T06:00:50.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46783 req_id = 4be6ab85-11ba-44b6-9915-1126b2e80b8f response_code = 200 uri = /vpc-routes
18602025-03-04T06:00:50.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49655 req_id = ad3dc79f-07c1-4cd8-bb38-a946ccf9d811 response_code = 200 uri = /network-bootstore-config
18612025-03-04T06:00:51.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18622025-03-04T06:00:51.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46783 req_id = 605fa5ef-4013-4f14-9330-4825201afdec response_code = 204 uri = /eip-gateways
18632025-03-04T06:00:51.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46783 req_id = 40468c80-ed41-4817-8b00-3282181f28a3 response_code = 204 uri = /vpc-routes
18642025-03-04T06:00:51.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37795
18652025-03-04T06:00:51.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18662025-03-04T06:00:51.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18672025-03-04T06:00:51.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37795 req_id = 109c4a69-3f60-4f14-b46a-c16f2aa740b9 response_code = 204 uri = /switch-ports
18682025-03-04T06:00:51.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53227
18692025-03-04T06:00:51.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53227 req_id = e7128477-a9ab-4803-ae12-cea15cf834f1 response_code = 200 uri = /v2p
18702025-03-04T06:00:51.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37795 req_id = 534139b4-6e02-446c-9c0d-0eb00222f05c response_code = 200 uri = /network-bootstore-config
18712025-03-04T06:01:00.254ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8058 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 229cd1ea-fd85-4700-ae24-d731848d292d response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
18722025-03-04T06:01:05.647ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35258
18732025-03-04T06:01:05.647ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35258 req_id = ef7519e4-1a8d-4290-8f37-37525fd7974c response_code = 200 uri = /baseboard
18742025-03-04T06:01:20.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48130
18752025-03-04T06:01:20.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48130 req_id = db86ae35-8870-4887-a0e7-58e3f8e5bdd8 response_code = 200 uri = /vpc-routes
18762025-03-04T06:01:20.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18772025-03-04T06:01:20.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48130 req_id = aa0e5b2c-ffee-44d1-831d-c83a842b3bf1 response_code = 204 uri = /eip-gateways
18782025-03-04T06:01:20.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48130 req_id = 13133f0c-71e7-43a0-9be2-be80e60f9994 response_code = 204 uri = /vpc-routes
18792025-03-04T06:01:20.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51965
18802025-03-04T06:01:20.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51965 req_id = 86cfb3f7-65ee-4731-861d-d3dd0f2fb33d response_code = 200 uri = /v2p
18812025-03-04T06:01:20.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34560
18822025-03-04T06:01:20.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18832025-03-04T06:01:20.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18842025-03-04T06:01:20.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34560 req_id = 1034dbaa-0eaf-4b31-b0c8-41bc4326934e response_code = 204 uri = /switch-ports
18852025-03-04T06:01:20.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34560 req_id = 8cbfc231-013b-4696-86ef-084343c37039 response_code = 200 uri = /network-bootstore-config
18862025-03-04T06:01:20.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54417
18872025-03-04T06:01:20.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54417 req_id = 88b5dfff-03dd-40f5-8145-a8ef47b89e4e response_code = 200 uri = /vpc-routes
18882025-03-04T06:01:20.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
18892025-03-04T06:01:20.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54417 req_id = 4e989621-f3a8-49a7-8654-9d8c8e592935 response_code = 204 uri = /eip-gateways
18902025-03-04T06:01:20.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54417 req_id = d8596897-08e2-4540-9f32-bb0c3ec8558d response_code = 204 uri = /vpc-routes
18912025-03-04T06:01:20.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64670
18922025-03-04T06:01:20.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64670 req_id = 3c77798f-d3ac-4923-b5e9-56ea803f5225 response_code = 200 uri = /v2p
18932025-03-04T06:01:20.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33437
18942025-03-04T06:01:20.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
18952025-03-04T06:01:20.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
18962025-03-04T06:01:20.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33437 req_id = e9d4fe2f-57ad-4a58-a221-1d90705ea4be response_code = 204 uri = /switch-ports
18972025-03-04T06:01:20.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33437 req_id = f38d7b87-8fad-4f5a-9969-c48eddfee7fb response_code = 200 uri = /network-bootstore-config
18982025-03-04T06:01:20.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36258
18992025-03-04T06:01:20.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36258 req_id = 5ca63ab4-a6d3-466b-b8e4-45e86af55dca response_code = 200 uri = /vpc-routes
19002025-03-04T06:01:20.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19012025-03-04T06:01:20.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36258 req_id = 3c83539c-5e3b-45a3-bb6d-605aab018c56 response_code = 204 uri = /eip-gateways
19022025-03-04T06:01:20.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58242
19032025-03-04T06:01:20.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58242 req_id = 005dfbc2-8a44-46e5-9b42-8eb3945eb0c6 response_code = 200 uri = /v2p
19042025-03-04T06:01:20.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36258 req_id = 70a55e32-620d-4387-b64a-6d2eb5ba27bd response_code = 204 uri = /vpc-routes
19052025-03-04T06:01:20.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59680
19062025-03-04T06:01:20.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19072025-03-04T06:01:20.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19082025-03-04T06:01:20.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59680 req_id = 1cc73153-be47-4ee0-8df6-8247b6a1aad0 response_code = 204 uri = /switch-ports
19092025-03-04T06:01:20.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59680 req_id = 7954823d-3cf9-42c7-a947-617efb83ad25 response_code = 200 uri = /network-bootstore-config
19102025-03-04T06:01:28.043ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
19112025-03-04T06:01:28.044ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
19122025-03-04T06:01:28.044ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
19132025-03-04T06:01:28.044ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
19142025-03-04T06:01:30.256ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9088 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 274d06ee-f61b-40fe-b8a0-90a9ea37a27f response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
19152025-03-04T06:01:35.698ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64434
19162025-03-04T06:01:35.698ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64434 req_id = 9939d3e9-1344-48ba-a910-d9bec94c4170 response_code = 200 uri = /baseboard
19172025-03-04T06:01:43.298ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
19182025-03-04T06:01:50.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58877
19192025-03-04T06:01:50.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58877 req_id = 595e25c8-61d5-4a03-b3ef-08e6167bc323 response_code = 200 uri = /vpc-routes
19202025-03-04T06:01:50.136ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19212025-03-04T06:01:50.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58877 req_id = 78fafa7d-b04c-486c-9e4a-5d6466ea94e0 response_code = 204 uri = /eip-gateways
19222025-03-04T06:01:50.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59257
19232025-03-04T06:01:50.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59257 req_id = 897b0b5b-7053-4342-8d6b-c979f9ae1e0a response_code = 200 uri = /v2p
19242025-03-04T06:01:50.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58877 req_id = c49ff702-d83e-4492-baac-20f4593d24cb response_code = 204 uri = /vpc-routes
19252025-03-04T06:01:50.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41656
19262025-03-04T06:01:50.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19272025-03-04T06:01:50.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19282025-03-04T06:01:50.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41656 req_id = 2b0160d9-fffe-4a2b-9c72-af02f882d498 response_code = 204 uri = /switch-ports
19292025-03-04T06:01:50.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41656 req_id = 493bc8e2-b8c4-4cd8-95b9-7028f2e67242 response_code = 200 uri = /network-bootstore-config
19302025-03-04T06:01:50.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44612
19312025-03-04T06:01:50.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44612 req_id = 9b190168-d288-467d-b023-e7451651fad4 response_code = 200 uri = /v2p
19322025-03-04T06:01:50.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57823
19332025-03-04T06:01:50.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57823 req_id = f971c9aa-7491-4fbf-89ff-cb6e4f4f913c response_code = 200 uri = /vpc-routes
19342025-03-04T06:01:50.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19352025-03-04T06:01:50.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57823 req_id = f970d8d0-d584-45f5-a159-c431665bf207 response_code = 204 uri = /eip-gateways
19362025-03-04T06:01:50.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57823 req_id = 5c0f6d78-a63f-4611-aaed-343f40ab21f4 response_code = 204 uri = /vpc-routes
19372025-03-04T06:01:50.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54114
19382025-03-04T06:01:50.782ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19392025-03-04T06:01:50.819ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19402025-03-04T06:01:50.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54114 req_id = 785f4531-c06d-4c73-b086-f159dd4ca266 response_code = 204 uri = /switch-ports
19412025-03-04T06:01:50.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45425
19422025-03-04T06:01:50.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45425 req_id = 03a08b26-a93f-48e2-9bd5-62f829377ecc response_code = 200 uri = /vpc-routes
19432025-03-04T06:01:50.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54114 req_id = 6001af4b-3034-47ac-96c1-40b15a33f27e response_code = 200 uri = /network-bootstore-config
19442025-03-04T06:01:50.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19452025-03-04T06:01:50.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45425 req_id = 714a2970-87b1-4f0c-ae5b-cf5221b9172a response_code = 204 uri = /eip-gateways
19462025-03-04T06:01:50.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45425 req_id = 7341a047-391b-4efd-9229-5f22b4872457 response_code = 204 uri = /vpc-routes
19472025-03-04T06:01:51.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49467
19482025-03-04T06:01:51.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49467 req_id = be4a8caf-45ae-48dc-8f6a-f048c94c8139 response_code = 200 uri = /v2p
19492025-03-04T06:01:51.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41344
19502025-03-04T06:01:51.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19512025-03-04T06:01:51.138ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19522025-03-04T06:01:51.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41344 req_id = b293c9f9-086e-446b-bc3c-f1af36c69195 response_code = 204 uri = /switch-ports
19532025-03-04T06:01:51.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41344 req_id = a91c11c1-818d-476a-9340-6ca8790d77ea response_code = 200 uri = /network-bootstore-config
19542025-03-04T06:02:00.255ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7546 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 6c61444e-b317-4382-bea6-8b527096ed8a response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
19552025-03-04T06:02:05.732ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51561
19562025-03-04T06:02:05.732ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51561 req_id = d762bdc4-8ec2-4248-86a1-edfd88c81910 response_code = 200 uri = /baseboard
19572025-03-04T06:02:19.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62892
19582025-03-04T06:02:19.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62892 req_id = af45d3f4-fa84-475a-8d22-535786302e0e response_code = 200 uri = /vpc-routes
19592025-03-04T06:02:20.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19602025-03-04T06:02:20.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62892 req_id = 0ae0a8d3-bbf2-4598-be37-a28f3c37d24a response_code = 204 uri = /eip-gateways
19612025-03-04T06:02:20.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44614
19622025-03-04T06:02:20.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44614 req_id = 9cc4d6eb-4499-46aa-be06-423a6c61f7c9 response_code = 200 uri = /v2p
19632025-03-04T06:02:20.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62892 req_id = 2fdb3feb-4262-484d-8b4e-f99548f69c7c response_code = 204 uri = /vpc-routes
19642025-03-04T06:02:20.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33244
19652025-03-04T06:02:20.088ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19662025-03-04T06:02:20.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19672025-03-04T06:02:20.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33244 req_id = 12ce13e3-5dbe-489b-9ecf-b850682a1f7c response_code = 204 uri = /switch-ports
19682025-03-04T06:02:20.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33244 req_id = b1f69a8b-2ab9-438a-b8f8-10f024268b02 response_code = 200 uri = /network-bootstore-config
19692025-03-04T06:02:20.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47662
19702025-03-04T06:02:20.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47662 req_id = aa08e9bd-4962-4ff8-99b7-8d7e2646f783 response_code = 200 uri = /vpc-routes
19712025-03-04T06:02:20.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19722025-03-04T06:02:20.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47662 req_id = 03dab0b6-833b-40f0-ab70-29ca6f34503c response_code = 204 uri = /eip-gateways
19732025-03-04T06:02:20.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47662 req_id = 48ee0b62-5d56-4881-b439-6874b238a97d response_code = 204 uri = /vpc-routes
19742025-03-04T06:02:20.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53924
19752025-03-04T06:02:20.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53924 req_id = ed1ad8b3-e2a4-440d-8b0a-29f7fd4bf836 response_code = 200 uri = /v2p
19762025-03-04T06:02:20.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51738
19772025-03-04T06:02:20.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19782025-03-04T06:02:20.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19792025-03-04T06:02:20.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51738 req_id = f742f06d-fd7a-4d9c-9625-5526c0c3ebc7 response_code = 204 uri = /switch-ports
19802025-03-04T06:02:20.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54747
19812025-03-04T06:02:20.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54747 req_id = 028c6009-7b5e-479c-baa9-b84bdcb48efe response_code = 200 uri = /vpc-routes
19822025-03-04T06:02:20.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51738 req_id = ed70a0fa-c654-472f-8e6f-0722fc255651 response_code = 200 uri = /network-bootstore-config
19832025-03-04T06:02:20.738ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
19842025-03-04T06:02:20.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54747 req_id = 5ad476c8-e8bb-45fb-9b94-2914a0a9bef4 response_code = 204 uri = /eip-gateways
19852025-03-04T06:02:20.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54747 req_id = 1dd2370b-50a2-4427-8228-64248ebbc96c response_code = 204 uri = /vpc-routes
19862025-03-04T06:02:20.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63381
19872025-03-04T06:02:20.823ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19882025-03-04T06:02:20.861ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19892025-03-04T06:02:20.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63381 req_id = 148f5d57-8e45-4620-a5e9-8882efa12cc9 response_code = 204 uri = /switch-ports
19902025-03-04T06:02:20.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41392
19912025-03-04T06:02:20.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41392 req_id = 8b2cfad3-4f2f-45ba-b4f3-28ab454ff13b response_code = 200 uri = /v2p
19922025-03-04T06:02:20.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63381 req_id = 803a6c5a-8749-4872-ab45-f23009fbc73c response_code = 200 uri = /network-bootstore-config
19932025-03-04T06:02:28.045ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
19942025-03-04T06:02:28.045ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
19952025-03-04T06:02:28.045ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
19962025-03-04T06:02:28.045ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
19972025-03-04T06:02:30.254ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7012 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = d79d7e16-cd8a-4622-a124-238f36d0a637 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
19982025-03-04T06:02:35.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65398
19992025-03-04T06:02:35.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65398 req_id = a99f850e-956a-4a73-bef0-d3592ad6000b response_code = 200 uri = /baseboard
20002025-03-04T06:02:50.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60122
20012025-03-04T06:02:50.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60122 req_id = e1afdef6-aa19-4e32-98be-9651309e6e52 response_code = 200 uri = /vpc-routes
20022025-03-04T06:02:50.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20032025-03-04T06:02:50.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60122 req_id = 051e48a9-827a-483d-a63b-91772b27c798 response_code = 204 uri = /eip-gateways
20042025-03-04T06:02:50.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60122 req_id = 0bf6a7a1-ef44-4f86-97fc-c3b4bbb175c5 response_code = 204 uri = /vpc-routes
20052025-03-04T06:02:50.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61547
20062025-03-04T06:02:50.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61547 req_id = 201e44f4-e828-4882-88fa-152fd81f376f response_code = 200 uri = /v2p
20072025-03-04T06:02:50.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45351
20082025-03-04T06:02:50.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20092025-03-04T06:02:50.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20102025-03-04T06:02:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45351 req_id = 24231fbe-201c-402b-a2bd-dd64809007a7 response_code = 204 uri = /switch-ports
20112025-03-04T06:02:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45351 req_id = a5201605-bfb4-4f11-8918-4c57468ca36a response_code = 200 uri = /network-bootstore-config
20122025-03-04T06:02:50.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37496
20132025-03-04T06:02:50.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37496 req_id = 882d130b-4b34-4e1e-8e81-5acb7475adc5 response_code = 200 uri = /vpc-routes
20142025-03-04T06:02:50.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20152025-03-04T06:02:50.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37496 req_id = 3cd0ad55-f927-4102-a03c-829bf8e347c2 response_code = 204 uri = /eip-gateways
20162025-03-04T06:02:50.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57275
20172025-03-04T06:02:50.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57275 req_id = da65bd4b-09e7-4583-a10c-651b11e099a7 response_code = 200 uri = /v2p
20182025-03-04T06:02:50.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37496 req_id = 4854fa72-c15d-4467-bd39-770cd2c63f76 response_code = 204 uri = /vpc-routes
20192025-03-04T06:02:50.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51070
20202025-03-04T06:02:50.882ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20212025-03-04T06:02:50.920ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20222025-03-04T06:02:50.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51070 req_id = ac4f2e13-7334-4963-aeba-935e92abf3fd response_code = 204 uri = /switch-ports
20232025-03-04T06:02:50.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50305
20242025-03-04T06:02:50.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50305 req_id = 4091c218-436b-4e68-ad4e-303ff685dafa response_code = 200 uri = /vpc-routes
20252025-03-04T06:02:50.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51070 req_id = 9506e32a-218a-41c3-8742-ed53c72426d0 response_code = 200 uri = /network-bootstore-config
20262025-03-04T06:02:50.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55187
20272025-03-04T06:02:50.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55187 req_id = 5328bd76-e5a1-471d-9656-ef70dc73342d response_code = 200 uri = /v2p
20282025-03-04T06:02:51.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20292025-03-04T06:02:51.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50305 req_id = bb95ffd1-8853-473a-b2bf-7f3b231629cd response_code = 204 uri = /eip-gateways
20302025-03-04T06:02:51.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50305 req_id = 0267449f-e57f-4798-81b3-2088de180457 response_code = 204 uri = /vpc-routes
20312025-03-04T06:02:51.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34409
20322025-03-04T06:02:51.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20332025-03-04T06:02:51.210ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20342025-03-04T06:02:51.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34409 req_id = 8a8505d6-a40f-4600-9ef1-90e9e5513f31 response_code = 204 uri = /switch-ports
20352025-03-04T06:02:51.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34409 req_id = c7a61f40-b9f8-4c59-a3ac-5b2f34e8ba54 response_code = 200 uri = /network-bootstore-config
20362025-03-04T06:03:00.255ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7234 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 6aa92960-1a5b-4f12-a311-44dd061a935d response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
20372025-03-04T06:03:05.801ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34568
20382025-03-04T06:03:05.801ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34568 req_id = 8267c1af-ee7c-4e8f-8d88-53c6cea78cad response_code = 200 uri = /baseboard
20392025-03-04T06:03:20.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59045
20402025-03-04T06:03:20.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59045 req_id = 925464e3-ea89-4dc5-a016-4a38a3fb6f4b response_code = 200 uri = /vpc-routes
20412025-03-04T06:03:20.103ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20422025-03-04T06:03:20.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59045 req_id = 608ba0d2-35cd-49c5-9699-bf1bbbdc834e response_code = 204 uri = /eip-gateways
20432025-03-04T06:03:20.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59045 req_id = 566d598c-1f31-4186-8752-e12b7c26acb1 response_code = 204 uri = /vpc-routes
20442025-03-04T06:03:20.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39305
20452025-03-04T06:03:20.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39305 req_id = 4e93feab-c607-43f1-a66f-cbc91bec3c42 response_code = 200 uri = /v2p
20462025-03-04T06:03:20.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34979
20472025-03-04T06:03:20.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20482025-03-04T06:03:20.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20492025-03-04T06:03:20.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114549 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34979 req_id = 9ac3c7ad-7d22-430e-9dfa-c6cdf0faff60 response_code = 204 uri = /switch-ports
20502025-03-04T06:03:20.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34979 req_id = eb3dc2f1-aad3-4821-9630-6c37a4975f98 response_code = 200 uri = /network-bootstore-config
20512025-03-04T06:03:20.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48429
20522025-03-04T06:03:20.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48429 req_id = 8ce1c491-e65e-461f-9105-be45325485c5 response_code = 200 uri = /vpc-routes
20532025-03-04T06:03:20.569ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20542025-03-04T06:03:20.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48429 req_id = f25a4468-f201-44fe-a807-7ddb1d98d231 response_code = 204 uri = /eip-gateways
20552025-03-04T06:03:20.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48429 req_id = 8199ffc1-fd4a-41b8-89c8-8e161b13902b response_code = 204 uri = /vpc-routes
20562025-03-04T06:03:20.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53359
20572025-03-04T06:03:20.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20582025-03-04T06:03:20.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20592025-03-04T06:03:20.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53359 req_id = 02cad067-7c5f-47dc-b4f7-497d20ec2173 response_code = 204 uri = /switch-ports
20602025-03-04T06:03:20.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37047
20612025-03-04T06:03:20.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37047 req_id = 918e3430-3aa0-4707-a25a-f5321ae41614 response_code = 200 uri = /v2p
20622025-03-04T06:03:20.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53359 req_id = 7fdf9ffd-1ce2-4d28-8790-a2ffd5fa79f5 response_code = 200 uri = /network-bootstore-config
20632025-03-04T06:03:20.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56501
20642025-03-04T06:03:20.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 68026764-99bf-44d6-b66f-832f3fc854a6 response_code = 200 uri = /vpc-routes
20652025-03-04T06:03:20.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20662025-03-04T06:03:20.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 732e7856-6908-4479-933c-ab8515269452 response_code = 204 uri = /eip-gateways
20672025-03-04T06:03:20.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 678af25a-80ec-4055-bafb-418ceafe6ad5 response_code = 204 uri = /vpc-routes
20682025-03-04T06:03:20.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42148
20692025-03-04T06:03:20.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42148 req_id = d9811ac2-f19a-4f30-8be7-e79704a3a775 response_code = 200 uri = /v2p
20702025-03-04T06:03:20.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39709
20712025-03-04T06:03:20.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20722025-03-04T06:03:20.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20732025-03-04T06:03:21.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39709 req_id = 920f18b8-e2ce-4944-ad1c-a56809b11eda response_code = 204 uri = /switch-ports
20742025-03-04T06:03:21.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39709 req_id = 8f89dedd-a079-4d85-aaa5-316b4bdcd374 response_code = 200 uri = /network-bootstore-config
20752025-03-04T06:03:28.045ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
20762025-03-04T06:03:28.046ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
20772025-03-04T06:03:28.046ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
20782025-03-04T06:03:28.046ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
20792025-03-04T06:03:30.255ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7765 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 36a7fc6f-486b-42d9-bdef-cdeff792c7d7 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
20802025-03-04T06:03:35.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45920
20812025-03-04T06:03:35.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45920 req_id = 3d24e0b2-4a6a-43bf-bb2b-29ea5cde4bb5 response_code = 200 uri = /baseboard
20822025-03-04T06:03:50.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57220
20832025-03-04T06:03:50.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20842025-03-04T06:03:50.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57220 req_id = e0eca187-5f52-4239-8dad-32d9803e6d93 response_code = 200 uri = /artifacts
20852025-03-04T06:03:50.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53740
20862025-03-04T06:03:50.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53740 req_id = 127748c8-d001-40e6-ba39-a29b16228a4c response_code = 200 uri = /v2p
20872025-03-04T06:03:50.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38127
20882025-03-04T06:03:50.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38127 req_id = de016a95-38b6-49af-8072-28225ae2d991 response_code = 200 uri = /vpc-routes
20892025-03-04T06:03:50.341ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
20902025-03-04T06:03:50.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38127 req_id = ed4876b9-a2ce-4afd-918c-d9b2092d3f86 response_code = 204 uri = /eip-gateways
20912025-03-04T06:03:50.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38127 req_id = fe2d63aa-734d-40cf-8df6-c8ffc31889ce response_code = 204 uri = /vpc-routes
20922025-03-04T06:03:50.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45742
20932025-03-04T06:03:50.458ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20942025-03-04T06:03:50.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20952025-03-04T06:03:50.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45742 req_id = 20698c8a-33ab-4209-920f-2ad4e9d86fdb response_code = 204 uri = /switch-ports
20962025-03-04T06:03:50.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47202
20972025-03-04T06:03:50.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45742 req_id = 793b7ad1-bb93-446e-913c-a968781cb652 response_code = 200 uri = /network-bootstore-config
20982025-03-04T06:03:50.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47202 req_id = afd0a359-c63f-496a-91a1-b9fc6981744a response_code = 200 uri = /v2p
20992025-03-04T06:03:50.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38590
21002025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21012025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21022025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21032025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21042025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21052025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21062025-03-04T06:03:50.663ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21072025-03-04T06:03:50.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38590 req_id = c4396d4d-be87-4d7e-b98f-d86e7a3c128d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21082025-03-04T06:03:50.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43919
21092025-03-04T06:03:50.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43919 req_id = 7a94324d-fe78-4869-8871-4ebb2112d9b7 response_code = 200 uri = /vpc-routes
21102025-03-04T06:03:50.765ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
21112025-03-04T06:03:50.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43919 req_id = 22e0f5e2-378c-4372-aa7f-286f86a70cc9 response_code = 204 uri = /eip-gateways
21122025-03-04T06:03:50.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43919 req_id = e96cfc58-9bd6-4731-95ef-459ab202480c response_code = 204 uri = /vpc-routes
21132025-03-04T06:03:50.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48656
21142025-03-04T06:03:50.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21152025-03-04T06:03:50.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21162025-03-04T06:03:50.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48656 req_id = e0cae3f2-d297-4da9-baf5-701333778ae1 response_code = 204 uri = /switch-ports
21172025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55340
21182025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63960
21192025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61416
21202025-03-04T06:03:50.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21212025-03-04T06:03:50.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21222025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63960 req_id = 7070723e-7be7-469f-ab77-2829bae6de35 response_code = 200 uri = /vpc-routes
21232025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48656 req_id = 67b6ef85-df62-4c22-a712-39b1cc52923d response_code = 200 uri = /network-bootstore-config
21242025-03-04T06:03:50.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61416 req_id = ab4e751c-3038-45b0-894b-c198e8e4fd60 response_code = 200 uri = /artifacts
21252025-03-04T06:03:50.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55340 req_id = 3a349fbc-3c44-4e0c-ac0e-925ce32cd876 response_code = 200 uri = /artifacts
21262025-03-04T06:03:50.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
21272025-03-04T06:03:50.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63960 req_id = 67923cac-8632-4ae2-a382-a1da96e07fee response_code = 204 uri = /eip-gateways
21282025-03-04T06:03:50.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63960 req_id = b3f6f883-d2e7-4e75-a155-bb8c2ad08721 response_code = 204 uri = /vpc-routes
21292025-03-04T06:03:51.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48732
21302025-03-04T06:03:51.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48732 req_id = 20fc0b6b-c657-433e-ac18-cdf8b0ebf043 response_code = 200 uri = /v2p
21312025-03-04T06:03:51.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50821
21322025-03-04T06:03:51.088ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21332025-03-04T06:03:51.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21342025-03-04T06:03:51.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50821 req_id = d714445b-e2f3-4c05-b14c-ed1010beab24 response_code = 204 uri = /switch-ports
21352025-03-04T06:03:51.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47177
21362025-03-04T06:03:51.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43497
21372025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21382025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21392025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21402025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21412025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21422025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21432025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21442025-03-04T06:03:51.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43497 req_id = c866b198-308b-427f-b4e5-e1b28cd75b5d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21452025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21462025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21472025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21482025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21492025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21502025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21512025-03-04T06:03:51.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21522025-03-04T06:03:51.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50821 req_id = ce0ed0cd-a3aa-4406-bc28-4808aff0f28f response_code = 200 uri = /network-bootstore-config
21532025-03-04T06:03:51.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47177 req_id = 4eb31d9a-d876-4009-b7bf-9584421071d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21542025-03-04T06:04:00.255ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6705 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 14004fee-9a51-47e5-b25d-20dc8a99c857 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
21552025-03-04T06:04:05.868ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55543
21562025-03-04T06:04:05.869ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55543 req_id = 763057da-af8c-4c00-9109-4ca3b74b6160 response_code = 200 uri = /baseboard
21572025-03-04T06:04:20.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64652
21582025-03-04T06:04:20.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64652 req_id = 2ead9349-2b73-41f0-9c3d-e20fe1d8e22f response_code = 200 uri = /vpc-routes
21592025-03-04T06:04:20.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33626
21602025-03-04T06:04:20.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33626 req_id = 8f12c67c-4d77-4592-bd08-491536035c79 response_code = 200 uri = /v2p
21612025-03-04T06:04:20.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
21622025-03-04T06:04:20.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64652 req_id = be8f41cc-3063-4eee-81ee-3a43d609ae12 response_code = 204 uri = /eip-gateways
21632025-03-04T06:04:20.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64652 req_id = 972c4e7a-efb2-43be-a61d-9eae93214cc4 response_code = 204 uri = /vpc-routes
21642025-03-04T06:04:20.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52400
21652025-03-04T06:04:20.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21662025-03-04T06:04:20.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21672025-03-04T06:04:20.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52400 req_id = 80655087-ac62-477c-848d-a1e8e6045eb5 response_code = 204 uri = /switch-ports
21682025-03-04T06:04:20.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52400 req_id = b79d5a52-a219-4f52-ba1b-022fe248b517 response_code = 200 uri = /network-bootstore-config
21692025-03-04T06:04:20.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49674
21702025-03-04T06:04:20.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49674 req_id = 26a774a3-a95d-4ada-8f26-5174faa0919b response_code = 200 uri = /vpc-routes
21712025-03-04T06:04:20.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
21722025-03-04T06:04:20.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49674 req_id = 54071bd7-3824-42cb-a09e-aa8784d44759 response_code = 204 uri = /eip-gateways
21732025-03-04T06:04:20.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49674 req_id = 44cdbfd1-14e0-43c8-bcd3-a03d7e3641b7 response_code = 204 uri = /vpc-routes
21742025-03-04T06:04:20.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36740
21752025-03-04T06:04:20.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36740 req_id = 427410c8-f032-4a95-8f73-3927b0d1002f response_code = 200 uri = /v2p
21762025-03-04T06:04:20.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44911
21772025-03-04T06:04:20.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21782025-03-04T06:04:20.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21792025-03-04T06:04:20.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44911 req_id = d069e113-1b98-430c-9991-78bc09a8637d response_code = 204 uri = /switch-ports
21802025-03-04T06:04:20.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51711
21812025-03-04T06:04:20.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51711 req_id = 84141d54-9a49-4ad2-ba1c-ce78f6925711 response_code = 200 uri = /vpc-routes
21822025-03-04T06:04:20.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44911 req_id = 0641d627-3429-4875-864c-84657905b702 response_code = 200 uri = /network-bootstore-config
21832025-03-04T06:04:20.800ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
21842025-03-04T06:04:20.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51711 req_id = e89e6882-f353-4e38-87d3-8e82df747799 response_code = 204 uri = /eip-gateways
21852025-03-04T06:04:20.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51711 req_id = fc62fdc9-e553-4d00-8734-ec3d59836b60 response_code = 204 uri = /vpc-routes
21862025-03-04T06:04:20.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36948
21872025-03-04T06:04:20.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21882025-03-04T06:04:20.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21892025-03-04T06:04:20.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36948 req_id = 96520f34-c790-46e4-8b19-39ee302f62fd response_code = 204 uri = /switch-ports
21902025-03-04T06:04:20.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57413
21912025-03-04T06:04:20.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57413 req_id = 428820c9-c0cf-47af-8d52-3443008a4761 response_code = 200 uri = /v2p
21922025-03-04T06:04:20.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36948 req_id = b0682c10-9135-48a1-aeb8-1306232ff45d response_code = 200 uri = /network-bootstore-config
21932025-03-04T06:04:28.046ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
21942025-03-04T06:04:28.046ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
21952025-03-04T06:04:28.046ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
21962025-03-04T06:04:28.046ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
21972025-03-04T06:04:30.257ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7498 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 42018bd5-0039-4e3c-9f62-81a5c3fe2e12 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
21982025-03-04T06:04:35.902ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50059
21992025-03-04T06:04:35.902ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50059 req_id = 131e8fcf-8fc2-4369-aefb-b62da146e886 response_code = 200 uri = /baseboard
22002025-03-04T06:04:50.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55907
22012025-03-04T06:04:50.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55907 req_id = dd207e8f-4d17-4564-b707-4971695046e2 response_code = 200 uri = /vpc-routes
22022025-03-04T06:04:50.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33545
22032025-03-04T06:04:50.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33545 req_id = 721fbf28-f920-4ae3-955b-6f7011da9413 response_code = 200 uri = /v2p
22042025-03-04T06:04:50.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22052025-03-04T06:04:50.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55907 req_id = 0109ce83-44b6-4008-8aac-036ad43b0721 response_code = 204 uri = /eip-gateways
22062025-03-04T06:04:50.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55907 req_id = feeb1054-d7e8-426e-a751-f9c867e5f4dd response_code = 204 uri = /vpc-routes
22072025-03-04T06:04:50.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54961
22082025-03-04T06:04:50.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54961 req_id = 6c0f7bd0-b0b8-4a8a-abac-3c0b1bc37a92 response_code = 200 uri = /vpc-routes
22092025-03-04T06:04:50.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45318
22102025-03-04T06:04:50.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22112025-03-04T06:04:50.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22122025-03-04T06:04:50.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45318 req_id = 3129d140-3851-4950-9358-8de0ca4225d6 response_code = 204 uri = /switch-ports
22132025-03-04T06:04:50.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22142025-03-04T06:04:50.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54961 req_id = 158b38b2-6207-421d-a739-7d2f5c4cc533 response_code = 204 uri = /eip-gateways
22152025-03-04T06:04:50.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45318 req_id = 6e34d04a-6cb6-46b8-bffa-1f077c255178 response_code = 200 uri = /network-bootstore-config
22162025-03-04T06:04:50.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 414 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54961 req_id = 7e9f58b2-e77e-444d-a7cd-486ff4a121f4 response_code = 204 uri = /vpc-routes
22172025-03-04T06:04:50.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60068
22182025-03-04T06:04:50.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60068 req_id = ee50e3f1-e4a3-4dc2-8bc7-a35a38353e9f response_code = 200 uri = /v2p
22192025-03-04T06:04:50.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60586
22202025-03-04T06:04:50.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22212025-03-04T06:04:50.792ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22222025-03-04T06:04:50.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60586 req_id = 6c127121-f037-456a-949b-80ddabffa44d response_code = 204 uri = /switch-ports
22232025-03-04T06:04:50.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40707
22242025-03-04T06:04:50.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60586 req_id = 9683d5b6-4129-41ba-a851-ae78c8abc198 response_code = 200 uri = /network-bootstore-config
22252025-03-04T06:04:50.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40707 req_id = 9af65bf9-69a2-4161-8081-81ca7e29228e response_code = 200 uri = /vpc-routes
22262025-03-04T06:04:50.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22272025-03-04T06:04:50.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40707 req_id = 9f0cfe57-9349-43f4-95b1-67ab30e82fab response_code = 204 uri = /eip-gateways
22282025-03-04T06:04:50.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40707 req_id = 0cb77d36-a99e-442e-a832-71596dc8432f response_code = 204 uri = /vpc-routes
22292025-03-04T06:04:51.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41816
22302025-03-04T06:04:51.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41816 req_id = ebe5f519-44cb-4c6e-bf23-483974c3d97a response_code = 200 uri = /v2p
22312025-03-04T06:04:51.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41124
22322025-03-04T06:04:51.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22332025-03-04T06:04:51.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22342025-03-04T06:04:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41124 req_id = aa8cabce-ded8-4794-9f4d-29565b4c1d1d response_code = 204 uri = /switch-ports
22352025-03-04T06:04:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41124 req_id = 18fea18b-9aa1-4d47-92f4-020cfbb52013 response_code = 200 uri = /network-bootstore-config
22362025-03-04T06:05:00.256ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6736 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 2a9ca71e-8efb-4a33-9af5-adccd41cb77d response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
22372025-03-04T06:05:05.936ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52184
22382025-03-04T06:05:05.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52184 req_id = d7874c0f-cc41-4065-8809-268f7e1c733e response_code = 200 uri = /baseboard
22392025-03-04T06:05:20.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35570
22402025-03-04T06:05:20.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35570 req_id = b57832fb-240b-4e9c-8de6-fcaadbb86531 response_code = 200 uri = /vpc-routes
22412025-03-04T06:05:20.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22422025-03-04T06:05:20.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35570 req_id = e1c0cd3b-cb8c-44d3-8fb2-e74dcd4e65d6 response_code = 204 uri = /eip-gateways
22432025-03-04T06:05:20.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35570 req_id = bf4a1f54-7dcf-43a8-993b-76d3f376bd14 response_code = 204 uri = /vpc-routes
22442025-03-04T06:05:20.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53438
22452025-03-04T06:05:20.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53438 req_id = edcb0407-4366-48b5-b206-b52052d47913 response_code = 200 uri = /v2p
22462025-03-04T06:05:20.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47341
22472025-03-04T06:05:20.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22482025-03-04T06:05:20.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22492025-03-04T06:05:20.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47341 req_id = 2fd9d838-44af-4834-ada3-6cb273021df8 response_code = 204 uri = /switch-ports
22502025-03-04T06:05:20.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47341 req_id = f022a4d9-39a1-4343-b769-d75366297d4d response_code = 200 uri = /network-bootstore-config
22512025-03-04T06:05:20.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40867
22522025-03-04T06:05:20.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40867 req_id = 52e19531-d285-4ebe-adb6-7f5e80aa1703 response_code = 200 uri = /vpc-routes
22532025-03-04T06:05:20.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56656
22542025-03-04T06:05:20.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56656 req_id = ed8ee87d-3fc8-4fb0-a660-d986f7d851ed response_code = 200 uri = /v2p
22552025-03-04T06:05:20.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22562025-03-04T06:05:20.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40867 req_id = 43f55622-21e1-4edb-b68f-b9c5c756db8f response_code = 204 uri = /eip-gateways
22572025-03-04T06:05:20.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40867 req_id = c18ad3cd-a376-4d8c-9101-9fc1a6f590ec response_code = 204 uri = /vpc-routes
22582025-03-04T06:05:20.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59970
22592025-03-04T06:05:20.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22602025-03-04T06:05:20.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22612025-03-04T06:05:20.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59970 req_id = 9c50d334-8da8-4aa1-b1ff-342320260fe8 response_code = 204 uri = /switch-ports
22622025-03-04T06:05:20.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59970 req_id = a794abd3-02bf-4914-b701-a3fd0191147d response_code = 200 uri = /network-bootstore-config
22632025-03-04T06:05:20.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35309
22642025-03-04T06:05:20.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35309 req_id = 61ca19ac-1304-4314-af45-38d5a3b2771d response_code = 200 uri = /vpc-routes
22652025-03-04T06:05:20.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22662025-03-04T06:05:20.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35309 req_id = 045f7e76-c728-4dc7-88d1-67f762cdcaf7 response_code = 204 uri = /eip-gateways
22672025-03-04T06:05:20.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42942
22682025-03-04T06:05:20.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42942 req_id = c6c99107-914b-45dc-b62d-d9a803b7d0ad response_code = 200 uri = /v2p
22692025-03-04T06:05:20.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35309 req_id = 34f72e6b-32e5-45ae-ae42-5dc1da839a3c response_code = 204 uri = /vpc-routes
22702025-03-04T06:05:20.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47658
22712025-03-04T06:05:20.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22722025-03-04T06:05:20.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22732025-03-04T06:05:20.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47658 req_id = 61b2a32e-5f8c-4d58-95ef-78d0c75db5a3 response_code = 204 uri = /switch-ports
22742025-03-04T06:05:20.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47658 req_id = 20bf3da4-2efc-47a0-8b5a-5c345d6635cf response_code = 200 uri = /network-bootstore-config
22752025-03-04T06:05:28.047ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
22762025-03-04T06:05:28.047ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
22772025-03-04T06:05:28.047ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
22782025-03-04T06:05:28.047ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
22792025-03-04T06:05:30.255ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6222 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = e06eb4dc-64d0-4172-a7d5-87dcc43ec453 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
22802025-03-04T06:05:35.969ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56891
22812025-03-04T06:05:35.970ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56891 req_id = de334170-d06b-407e-a869-239bf635d86e response_code = 200 uri = /baseboard
22822025-03-04T06:05:50.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38459
22832025-03-04T06:05:50.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38459 req_id = 057c7d0d-f0af-4c01-8f84-02f957e7dad9 response_code = 200 uri = /vpc-routes
22842025-03-04T06:05:50.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33984
22852025-03-04T06:05:50.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33984 req_id = b5f5f6eb-9c80-41a3-80dd-f41fc926a7c8 response_code = 200 uri = /v2p
22862025-03-04T06:05:50.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22872025-03-04T06:05:50.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38459 req_id = 835c6467-9051-40f7-8677-63594ced0f09 response_code = 204 uri = /eip-gateways
22882025-03-04T06:05:50.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38459 req_id = 078ad7b0-c574-44bd-b6d2-10df4763d488 response_code = 204 uri = /vpc-routes
22892025-03-04T06:05:50.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51602
22902025-03-04T06:05:50.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22912025-03-04T06:05:50.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22922025-03-04T06:05:50.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51602 req_id = 566c67c2-12c4-4838-9adb-c0b600212144 response_code = 204 uri = /switch-ports
22932025-03-04T06:05:50.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51602 req_id = 83c9bd89-4b13-43c6-931d-b3a94515eaf2 response_code = 200 uri = /network-bootstore-config
22942025-03-04T06:05:50.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56280
22952025-03-04T06:05:50.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56280 req_id = c83176a0-e950-4bcf-ab56-c6ea8141ee4b response_code = 200 uri = /vpc-routes
22962025-03-04T06:05:50.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
22972025-03-04T06:05:50.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56280 req_id = 901c5d28-0c8f-4b57-bd09-3fa4bec07998 response_code = 204 uri = /eip-gateways
22982025-03-04T06:05:50.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56280 req_id = e118ab19-b4bf-4eae-bfb7-50e3f91ae069 response_code = 204 uri = /vpc-routes
22992025-03-04T06:05:50.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46860
23002025-03-04T06:05:50.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46860 req_id = f91eaa32-69fb-42bf-af41-3c118482981f response_code = 200 uri = /vpc-routes
23012025-03-04T06:05:50.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61786
23022025-03-04T06:05:50.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61786 req_id = 217e4701-833d-45c1-85f8-8286e6f08752 response_code = 200 uri = /v2p
23032025-03-04T06:05:50.838ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23042025-03-04T06:05:50.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46860 req_id = 2af5235f-e704-471c-9ee6-cd243f9f8219 response_code = 204 uri = /eip-gateways
23052025-03-04T06:05:50.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46860 req_id = 81411bd1-605a-45ef-acb7-d2ac59f3202f response_code = 204 uri = /vpc-routes
23062025-03-04T06:05:50.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33162
23072025-03-04T06:05:50.890ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23082025-03-04T06:05:50.931ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23092025-03-04T06:05:50.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33162 req_id = a3d3e8d5-c776-45aa-b96c-224d4ce4c071 response_code = 204 uri = /switch-ports
23102025-03-04T06:05:50.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33162 req_id = a00712f0-5c70-4bda-bf77-f2f4ab855536 response_code = 200 uri = /network-bootstore-config
23112025-03-04T06:05:51.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32924
23122025-03-04T06:05:51.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32924 req_id = e96786ec-683f-4a33-957f-a72bce4480cc response_code = 200 uri = /v2p
23132025-03-04T06:05:51.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65432
23142025-03-04T06:05:51.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23152025-03-04T06:05:51.140ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23162025-03-04T06:05:51.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65432 req_id = 9cec88f6-61a7-4176-9e94-63c991432e42 response_code = 204 uri = /switch-ports
23172025-03-04T06:05:51.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65432 req_id = 378976aa-3df8-4bfe-9ce3-4d4168fd0888 response_code = 200 uri = /network-bootstore-config
23182025-03-04T06:06:00.257ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7178 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = b7993fa5-e5d5-4ee4-a32c-e2aaef3175d0 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
23192025-03-04T06:06:06.009ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57730
23202025-03-04T06:06:06.009ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57730 req_id = 20af0448-b090-410d-91a3-c68e83866eb3 response_code = 200 uri = /baseboard
23212025-03-04T06:06:19.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38613
23222025-03-04T06:06:19.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38613 req_id = b725d563-907d-42df-8666-031b8d2a5596 response_code = 200 uri = /vpc-routes
23232025-03-04T06:06:19.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23242025-03-04T06:06:19.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38613 req_id = 556a51c9-930d-4594-960d-d65cce9f6bd9 response_code = 204 uri = /eip-gateways
23252025-03-04T06:06:19.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38613 req_id = 4c1e328b-a31e-46e9-b1ab-d1c9825ba5d1 response_code = 204 uri = /vpc-routes
23262025-03-04T06:06:20.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48262
23272025-03-04T06:06:20.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48262 req_id = b673f9fd-9ea1-444a-a956-00e2212a9117 response_code = 200 uri = /v2p
23282025-03-04T06:06:20.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63309
23292025-03-04T06:06:20.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23302025-03-04T06:06:20.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23312025-03-04T06:06:20.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63309 req_id = f6ca0167-a72b-4b28-a223-86dd89d6a4ec response_code = 204 uri = /switch-ports
23322025-03-04T06:06:20.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63309 req_id = f83a38a2-bf1b-4fb6-962e-4be5a80a2ba3 response_code = 200 uri = /network-bootstore-config
23332025-03-04T06:06:20.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62480
23342025-03-04T06:06:20.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62480 req_id = 145d233b-bb7d-447b-8798-359ce8ba703d response_code = 200 uri = /vpc-routes
23352025-03-04T06:06:20.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42131
23362025-03-04T06:06:20.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42131 req_id = b4991fef-4079-4e49-b954-1c63d6cdd877 response_code = 200 uri = /v2p
23372025-03-04T06:06:20.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23382025-03-04T06:06:20.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62480 req_id = bf6fc140-4e22-49e4-9e56-765b9604203c response_code = 204 uri = /eip-gateways
23392025-03-04T06:06:20.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62480 req_id = 8b512f7a-efb0-422e-a2e8-9c4d6a3eefea response_code = 204 uri = /vpc-routes
23402025-03-04T06:06:20.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64144
23412025-03-04T06:06:20.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23422025-03-04T06:06:20.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23432025-03-04T06:06:20.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64144 req_id = c94652ee-3059-41d9-bb2f-77186aecdb3b response_code = 204 uri = /switch-ports
23442025-03-04T06:06:20.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61397
23452025-03-04T06:06:20.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61397 req_id = f57ff189-9714-4cb1-93bc-e2ba7e1cb033 response_code = 200 uri = /vpc-routes
23462025-03-04T06:06:20.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64144 req_id = a8db5dc7-ab2c-40a9-870d-62477f86e421 response_code = 200 uri = /network-bootstore-config
23472025-03-04T06:06:20.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23482025-03-04T06:06:20.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61397 req_id = 2bc0f7d0-08ec-4d1a-be6e-b90d9d57b4b5 response_code = 204 uri = /eip-gateways
23492025-03-04T06:06:20.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61397 req_id = e0867b82-a353-4e5b-94ab-44f284fe42b2 response_code = 204 uri = /vpc-routes
23502025-03-04T06:06:20.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48843
23512025-03-04T06:06:20.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23522025-03-04T06:06:20.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23532025-03-04T06:06:20.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92483 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48843 req_id = 25c5faed-ff81-465d-b773-c1b92c8566f9 response_code = 204 uri = /switch-ports
23542025-03-04T06:06:20.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50693
23552025-03-04T06:06:20.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50693 req_id = 6e7f20a2-afb9-4383-87d9-115fed1539c2 response_code = 200 uri = /v2p
23562025-03-04T06:06:20.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48843 req_id = c719ddb3-8547-45a6-b012-810c506bf646 response_code = 200 uri = /network-bootstore-config
23572025-03-04T06:06:28.047ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
23582025-03-04T06:06:28.047ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
23592025-03-04T06:06:28.047ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
23602025-03-04T06:06:28.048ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
23612025-03-04T06:06:29.112ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23622025-03-04T06:06:29.112ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23632025-03-04T06:06:29.138ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2094, tv_nsec: 749474214 } time_to_next_cleanup = 599.99999978s
23642025-03-04T06:06:30.259ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9269 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = c9d73de9-a5dd-48d7-b74b-8d45751cb389 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
23652025-03-04T06:06:36.043ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38586
23662025-03-04T06:06:36.044ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38586 req_id = aefc3c8f-4ea6-4c7c-ba54-6769e7f04eb4 response_code = 200 uri = /baseboard
23672025-03-04T06:06:43.303ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
23682025-03-04T06:06:50.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61712
23692025-03-04T06:06:50.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61712 req_id = b8812f6b-4cbd-4a1c-a9ca-aa16f0e6f4f8 response_code = 200 uri = /vpc-routes
23702025-03-04T06:06:50.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23712025-03-04T06:06:50.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61712 req_id = 428f0ede-2e00-4c54-a2b9-bc7e2dd31f2a response_code = 204 uri = /eip-gateways
23722025-03-04T06:06:50.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61712 req_id = a1870bc9-3e7c-40e0-b244-3974ad1e5a7f response_code = 204 uri = /vpc-routes
23732025-03-04T06:06:50.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33860
23742025-03-04T06:06:50.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33860 req_id = 2486a8a7-fe42-4649-8d4d-83776d2710b6 response_code = 200 uri = /v2p
23752025-03-04T06:06:50.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37493
23762025-03-04T06:06:50.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23772025-03-04T06:06:50.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23782025-03-04T06:06:50.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37493 req_id = e642a102-3277-42fa-a781-5a514d338c04 response_code = 204 uri = /switch-ports
23792025-03-04T06:06:50.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37493 req_id = 7f9a15b1-a920-4450-89e9-e8a88e88c34f response_code = 200 uri = /network-bootstore-config
23802025-03-04T06:06:50.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37586
23812025-03-04T06:06:50.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37586 req_id = 7efa7b41-0959-42e8-9c0b-b42dd168e5e7 response_code = 200 uri = /v2p
23822025-03-04T06:06:50.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50647
23832025-03-04T06:06:50.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50647 req_id = 9fc1accd-8f05-400e-8444-923a6675bb7b response_code = 200 uri = /vpc-routes
23842025-03-04T06:06:50.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23852025-03-04T06:06:50.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50647 req_id = ba618bec-199c-4521-a202-3a6d52a76d85 response_code = 204 uri = /eip-gateways
23862025-03-04T06:06:50.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50647 req_id = 199d5364-b53d-47ba-9c4a-10c148d48db7 response_code = 204 uri = /vpc-routes
23872025-03-04T06:06:50.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45960
23882025-03-04T06:06:50.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45960 req_id = a7efec73-b4a6-4486-87de-829e5a765556 response_code = 200 uri = /vpc-routes
23892025-03-04T06:06:50.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59436
23902025-03-04T06:06:50.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23912025-03-04T06:06:50.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23922025-03-04T06:06:50.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59436 req_id = ea1eef1b-0138-4577-9488-45800cdb5843 response_code = 204 uri = /switch-ports
23932025-03-04T06:06:50.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59436 req_id = b4f3a508-c0c5-4401-8fcd-1bb1e88913d4 response_code = 200 uri = /network-bootstore-config
23942025-03-04T06:06:51.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56087
23952025-03-04T06:06:51.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56087 req_id = f63a31cb-346a-44d7-b045-342777508fc1 response_code = 200 uri = /v2p
23962025-03-04T06:06:51.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
23972025-03-04T06:06:51.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45960 req_id = 2e6d7a64-030a-48a7-8dd8-003be2ac752f response_code = 204 uri = /eip-gateways
23982025-03-04T06:06:51.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45960 req_id = 43b0b149-3868-4db3-abaa-a60744eb1e7b response_code = 204 uri = /vpc-routes
23992025-03-04T06:06:51.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60427
24002025-03-04T06:06:51.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24012025-03-04T06:06:51.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24022025-03-04T06:06:51.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60427 req_id = a8b6fbf7-940a-4abf-9dca-d8de78b27b22 response_code = 204 uri = /switch-ports
24032025-03-04T06:06:51.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60427 req_id = 28d2880f-693c-4e35-a5d7-60ad8b91ac6d response_code = 200 uri = /network-bootstore-config
24042025-03-04T06:07:00.258ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7590 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 0568019e-e8af-4541-a000-d61c5e29b6ef response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
24052025-03-04T06:07:06.077ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40309
24062025-03-04T06:07:06.077ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40309 req_id = 8e1048c2-f59f-42a7-8e88-f17be54c5ae3 response_code = 200 uri = /baseboard
24072025-03-04T06:07:19.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48567
24082025-03-04T06:07:19.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48567 req_id = c53a42b7-c10d-41a5-b4d3-6eb5f5582b87 response_code = 200 uri = /vpc-routes
24092025-03-04T06:07:20.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24102025-03-04T06:07:20.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48567 req_id = cd70b0cb-1c0c-4662-a41f-b3dc99255b92 response_code = 204 uri = /eip-gateways
24112025-03-04T06:07:20.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48567 req_id = 4bc35d32-db78-4562-8953-51d253f7747e response_code = 204 uri = /vpc-routes
24122025-03-04T06:07:20.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43078
24132025-03-04T06:07:20.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43078 req_id = 60e5cab0-ae56-4e22-b88a-5c97d6a0745e response_code = 200 uri = /v2p
24142025-03-04T06:07:20.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46010
24152025-03-04T06:07:20.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24162025-03-04T06:07:20.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24172025-03-04T06:07:20.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117485 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46010 req_id = 0e1b996c-d98e-4fe3-8779-fd5ba2458f1f response_code = 204 uri = /switch-ports
24182025-03-04T06:07:20.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46010 req_id = 5b62cbb9-ec05-47ea-937c-29f0a8f0226c response_code = 200 uri = /network-bootstore-config
24192025-03-04T06:07:20.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40897
24202025-03-04T06:07:20.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40897 req_id = 853516e7-bb5c-4a01-b88b-d268896319cf response_code = 200 uri = /v2p
24212025-03-04T06:07:20.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50446
24222025-03-04T06:07:20.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50446 req_id = 3912a884-0a6a-4653-ad58-b169c93e632a response_code = 200 uri = /vpc-routes
24232025-03-04T06:07:20.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24242025-03-04T06:07:20.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50446 req_id = 3ce1e4b9-02c1-4ff7-b8cb-6bc0fa4bb0a1 response_code = 204 uri = /eip-gateways
24252025-03-04T06:07:20.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50446 req_id = fed505dd-5d77-4203-95d8-7a3449193f6c response_code = 204 uri = /vpc-routes
24262025-03-04T06:07:20.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46284
24272025-03-04T06:07:20.700ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24282025-03-04T06:07:20.739ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24292025-03-04T06:07:20.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46284 req_id = 7371b0fb-fa98-48b3-b0e5-e80c63821091 response_code = 204 uri = /switch-ports
24302025-03-04T06:07:20.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46284 req_id = ed0abd9d-79e3-4de7-9b5b-5cc985332d98 response_code = 200 uri = /network-bootstore-config
24312025-03-04T06:07:20.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38048
24322025-03-04T06:07:20.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38048 req_id = a467cefc-34c5-4d3c-8638-5914d02b5f8d response_code = 200 uri = /vpc-routes
24332025-03-04T06:07:20.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24342025-03-04T06:07:20.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38048 req_id = 37575efd-366c-4d2a-b2bb-bdaf89aa8036 response_code = 204 uri = /eip-gateways
24352025-03-04T06:07:20.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38048 req_id = 4255ede2-8323-4e39-8221-73862bb5ef3c response_code = 204 uri = /vpc-routes
24362025-03-04T06:07:20.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63462
24372025-03-04T06:07:20.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24382025-03-04T06:07:21.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24392025-03-04T06:07:21.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63462 req_id = e18115de-3ee6-4e4d-aae9-ec92cbbe0490 response_code = 204 uri = /switch-ports
24402025-03-04T06:07:21.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63462 req_id = 38013ae9-44ce-4ffd-9839-26201a527a9d response_code = 200 uri = /network-bootstore-config
24412025-03-04T06:07:21.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54308
24422025-03-04T06:07:21.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54308 req_id = 4221ec17-7496-4621-9f1e-af8574cc697b response_code = 200 uri = /v2p
24432025-03-04T06:07:28.048ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
24442025-03-04T06:07:28.049ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
24452025-03-04T06:07:28.049ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
24462025-03-04T06:07:28.049ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
24472025-03-04T06:07:30.258ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7022 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = e37f5277-d178-463e-8300-b2445f4e4c4e response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
24482025-03-04T06:07:36.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46883
24492025-03-04T06:07:36.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46883 req_id = 7d499441-e364-4513-a014-ef7a54c03b1c response_code = 200 uri = /baseboard
24502025-03-04T06:07:50.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63016
24512025-03-04T06:07:50.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63016 req_id = 4b4e91f0-b905-44df-a75c-3e869fd8e16d response_code = 200 uri = /vpc-routes
24522025-03-04T06:07:50.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24532025-03-04T06:07:50.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63016 req_id = 049a5034-31d5-402d-a06c-e204909cb93e response_code = 204 uri = /eip-gateways
24542025-03-04T06:07:50.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61640
24552025-03-04T06:07:50.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61640 req_id = df210d0b-e52b-4cb6-b099-9433179d1e7d response_code = 200 uri = /v2p
24562025-03-04T06:07:50.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63016 req_id = 7cacc89b-689e-49e7-9e27-642c11800f8b response_code = 204 uri = /vpc-routes
24572025-03-04T06:07:50.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43092
24582025-03-04T06:07:50.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24592025-03-04T06:07:50.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24602025-03-04T06:07:50.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43092 req_id = df34b99f-1e8a-47d0-bb7c-cf811099a6cb response_code = 204 uri = /switch-ports
24612025-03-04T06:07:50.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43092 req_id = 1d6266be-a593-4049-a954-892d25e18017 response_code = 200 uri = /network-bootstore-config
24622025-03-04T06:07:50.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46379
24632025-03-04T06:07:50.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 57beb939-e6ce-4b01-aecb-4392236a6e10 response_code = 200 uri = /vpc-routes
24642025-03-04T06:07:50.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48265
24652025-03-04T06:07:50.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48265 req_id = 406a0dfc-e7be-461a-9255-039bcabe90d6 response_code = 200 uri = /v2p
24662025-03-04T06:07:50.747ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24672025-03-04T06:07:50.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46379 req_id = f3d36c3e-65ba-45c6-8c73-7a9eb03e0291 response_code = 204 uri = /eip-gateways
24682025-03-04T06:07:50.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 83db67a7-7ac1-4e2f-b569-0d3dc47645b7 response_code = 204 uri = /vpc-routes
24692025-03-04T06:07:50.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64327
24702025-03-04T06:07:50.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24712025-03-04T06:07:50.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24722025-03-04T06:07:50.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64327 req_id = 3d8134bb-9c5d-4d37-a27d-5d1c398d3c42 response_code = 204 uri = /switch-ports
24732025-03-04T06:07:50.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64327 req_id = 41225d52-7363-4a05-a3c4-97035acad4b9 response_code = 200 uri = /network-bootstore-config
24742025-03-04T06:07:50.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62102
24752025-03-04T06:07:50.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62102 req_id = e79234ba-6ed1-4746-80bb-c516134522b5 response_code = 200 uri = /vpc-routes
24762025-03-04T06:07:50.949ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24772025-03-04T06:07:50.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62102 req_id = 80e9d09b-7bde-474a-9e94-2558abe229b8 response_code = 204 uri = /eip-gateways
24782025-03-04T06:07:51.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48817
24792025-03-04T06:07:51.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48817 req_id = 3db42e3b-d43a-441e-8e26-9abcd5f28b04 response_code = 200 uri = /v2p
24802025-03-04T06:07:51.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62102 req_id = 0aab529e-dc78-4d58-9fe2-733a14de8acf response_code = 204 uri = /vpc-routes
24812025-03-04T06:07:51.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51474
24822025-03-04T06:07:51.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24832025-03-04T06:07:51.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24842025-03-04T06:07:51.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51474 req_id = 1046158a-d919-48f8-bfa3-2daa1660b607 response_code = 204 uri = /switch-ports
24852025-03-04T06:07:51.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51474 req_id = 0929b3b9-25a0-4d89-9ff0-d055b7782200 response_code = 200 uri = /network-bootstore-config
24862025-03-04T06:08:00.259ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7582 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 651ca3d5-cfc0-44e3-8e18-2fd0cfb7eaaf response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
24872025-03-04T06:08:06.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60705
24882025-03-04T06:08:06.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60705 req_id = 29a88c3c-b1b7-4a67-b532-5e879501c4b2 response_code = 200 uri = /baseboard
24892025-03-04T06:08:20.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48626
24902025-03-04T06:08:20.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48626 req_id = f4d25821-e3c2-41c7-bb80-e3852773b5c3 response_code = 200 uri = /vpc-routes
24912025-03-04T06:08:20.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
24922025-03-04T06:08:20.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48626 req_id = b70da95a-ab11-458a-9264-d01688b5eb1e response_code = 204 uri = /eip-gateways
24932025-03-04T06:08:20.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48626 req_id = ab89ab0f-4692-4b5c-93b6-80a4f9658827 response_code = 204 uri = /vpc-routes
24942025-03-04T06:08:20.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46938
24952025-03-04T06:08:20.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46938 req_id = 1fd38ce8-e821-41f7-83c1-2439a5428d7f response_code = 200 uri = /v2p
24962025-03-04T06:08:20.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61128
24972025-03-04T06:08:20.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24982025-03-04T06:08:20.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24992025-03-04T06:08:20.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131031 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61128 req_id = 7ead71db-a2e7-4dcd-aee4-911969ee4583 response_code = 204 uri = /switch-ports
25002025-03-04T06:08:20.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61128 req_id = 8f86891a-cd9f-4b67-9907-24ef2d2e1eb2 response_code = 200 uri = /network-bootstore-config
25012025-03-04T06:08:20.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58265
25022025-03-04T06:08:20.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58265 req_id = ecfd9130-ba22-4fb0-bc76-fed6e52ca402 response_code = 200 uri = /vpc-routes
25032025-03-04T06:08:20.538ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
25042025-03-04T06:08:20.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58265 req_id = a092a12e-b0de-453a-bedd-7266b8c11085 response_code = 204 uri = /eip-gateways
25052025-03-04T06:08:20.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58265 req_id = 4fd331c1-f6dd-481c-963e-b7196accd374 response_code = 204 uri = /vpc-routes
25062025-03-04T06:08:20.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47809
25072025-03-04T06:08:20.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25082025-03-04T06:08:20.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25092025-03-04T06:08:20.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 0bd3a605-aa4e-46ae-87ea-45a98cbdbd08 response_code = 204 uri = /switch-ports
25102025-03-04T06:08:20.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36142
25112025-03-04T06:08:20.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36142 req_id = 94c08710-4b8a-41aa-a996-a5e4f65dcbdb response_code = 200 uri = /v2p
25122025-03-04T06:08:20.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 957a0642-7472-439f-91c3-07b9033fe45a response_code = 200 uri = /network-bootstore-config
25132025-03-04T06:08:20.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45636
25142025-03-04T06:08:20.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45636 req_id = adc1005d-dc11-47b2-9f69-d0146696522f response_code = 200 uri = /vpc-routes
25152025-03-04T06:08:20.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44875
25162025-03-04T06:08:20.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44875 req_id = 3d02caed-85d5-4e28-94be-641ac2299bf1 response_code = 200 uri = /v2p
25172025-03-04T06:08:20.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
25182025-03-04T06:08:20.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45636 req_id = 6014030c-c2b7-4092-80db-49ab2662e433 response_code = 204 uri = /eip-gateways
25192025-03-04T06:08:20.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45636 req_id = c2e4377c-5b89-4db0-b642-2115506a1c1e response_code = 204 uri = /vpc-routes
25202025-03-04T06:08:20.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50517
25212025-03-04T06:08:20.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25222025-03-04T06:08:20.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25232025-03-04T06:08:20.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50517 req_id = 8741283b-740a-4380-be0d-d968f731b3cd response_code = 204 uri = /switch-ports
25242025-03-04T06:08:20.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50517 req_id = a7b51d36-aa40-4c95-a084-1da74ff16ae3 response_code = 200 uri = /network-bootstore-config
25252025-03-04T06:08:28.049ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
25262025-03-04T06:08:28.050ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
25272025-03-04T06:08:28.050ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
25282025-03-04T06:08:28.050ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
25292025-03-04T06:08:30.259ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8084 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = ad2da9c5-d9d3-4fe4-9f90-636a9c0dbda0 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
25302025-03-04T06:08:36.178ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49296
25312025-03-04T06:08:36.178ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49296 req_id = 37f5c32c-48b7-4105-b7f3-87e62c5e2e06 response_code = 200 uri = /baseboard
25322025-03-04T06:08:50.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56777
25332025-03-04T06:08:50.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56777 req_id = a6c3b7d2-8050-41f1-8ae7-3bbbd4064eb9 response_code = 200 uri = /v2p
25342025-03-04T06:08:50.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33202
25352025-03-04T06:08:50.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25362025-03-04T06:08:50.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33202 req_id = 71f084f6-b2a9-48d3-aa99-8d68c8f18470 response_code = 200 uri = /artifacts
25372025-03-04T06:08:50.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52521
25382025-03-04T06:08:50.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52521 req_id = 7df7a909-f6d7-47a1-b544-bb8ba99aae15 response_code = 200 uri = /vpc-routes
25392025-03-04T06:08:50.440ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
25402025-03-04T06:08:50.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52521 req_id = 4f2ec6ed-c03e-41b3-a3b4-41206f4a1909 response_code = 204 uri = /eip-gateways
25412025-03-04T06:08:50.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58529
25422025-03-04T06:08:50.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25432025-03-04T06:08:50.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25442025-03-04T06:08:50.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
25452025-03-04T06:08:50.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
25462025-03-04T06:08:50.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52521 req_id = 225a5873-2f9f-445a-82f2-46874b14ef68 response_code = 204 uri = /vpc-routes
25472025-03-04T06:08:50.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62932
25482025-03-04T06:08:50.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25492025-03-04T06:08:50.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25502025-03-04T06:08:50.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1c45276e-4032-4af7-b0dd-228abf1563e5
25512025-03-04T06:08:50.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25522025-03-04T06:08:50.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1
25532025-03-04T06:08:50.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25542025-03-04T06:08:50.543ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25552025-03-04T06:08:50.543ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8
25562025-03-04T06:08:50.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572025-03-04T06:08:50.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0
25582025-03-04T06:08:50.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62932 req_id = 7b69c7a0-d4cb-4b66-a591-b8555523812f response_code = 204 uri = /switch-ports
25592025-03-04T06:08:50.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62932 req_id = 42c8c470-c7b0-4d6d-b62f-df61eb4de538 response_code = 200 uri = /network-bootstore-config
25602025-03-04T06:08:50.622ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25612025-03-04T06:08:50.622ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b
25622025-03-04T06:08:50.662ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25632025-03-04T06:08:50.662ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b
25642025-03-04T06:08:50.689ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652025-03-04T06:08:50.689ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_862379c5-061f-49d2-8232-148b101e17d0
25662025-03-04T06:08:50.712ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25672025-03-04T06:08:50.712ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f
25682025-03-04T06:08:50.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25692025-03-04T06:08:50.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1
25702025-03-04T06:08:50.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59272
25712025-03-04T06:08:50.743ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25722025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25732025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25742025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25752025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25762025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25772025-03-04T06:08:50.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25782025-03-04T06:08:50.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 899 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59272 req_id = 2d2364af-e67f-4c27-8b11-7fc907412ee3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25792025-03-04T06:08:50.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58529 req_id = 7edd7c98-5857-4ba3-9df2-97f26bfddd95 response_code = 200 uri = /inventory
25802025-03-04T06:08:50.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58955
25812025-03-04T06:08:50.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58955 req_id = 4d75e12b-d12b-485c-9fd7-8a24b25b6114 response_code = 200 uri = /vpc-routes
25822025-03-04T06:08:50.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34464
25832025-03-04T06:08:50.849ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25842025-03-04T06:08:50.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34464 req_id = 56e131af-9641-43ee-be91-69a4a379a3b2 response_code = 200 uri = /artifacts
25852025-03-04T06:08:50.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
25862025-03-04T06:08:50.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58955 req_id = 54288d3f-bd83-4786-b0f9-2bda91d943c8 response_code = 204 uri = /eip-gateways
25872025-03-04T06:08:50.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58955 req_id = 8d387654-0c0b-42d9-bd31-bf3ffba23a2d response_code = 204 uri = /vpc-routes
25882025-03-04T06:08:50.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39417
25892025-03-04T06:08:50.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25902025-03-04T06:08:50.962ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25912025-03-04T06:08:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39417 req_id = 9e781fa7-7b3e-4edf-b734-5c4e86aac54f response_code = 204 uri = /switch-ports
25922025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49966
25932025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60070
25942025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62483
25952025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62483 req_id = 2d13fbfd-3842-4b6a-b58a-00f72eaa89af response_code = 200 uri = /v2p
25962025-03-04T06:08:51.017ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25972025-03-04T06:08:51.017ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25982025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49966 req_id = 9e02fcda-c900-451f-ab28-736909916c4f response_code = 200 uri = /vpc-routes
25992025-03-04T06:08:51.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39417 req_id = 152b5548-b9ee-48e1-a46c-4732e118bd9f response_code = 200 uri = /network-bootstore-config
26002025-03-04T06:08:51.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
26012025-03-04T06:08:51.018ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
26022025-03-04T06:08:51.033ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26032025-03-04T06:08:51.033ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1c45276e-4032-4af7-b0dd-228abf1563e5
26042025-03-04T06:08:51.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65151
26052025-03-04T06:08:51.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26062025-03-04T06:08:51.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65151 req_id = 8b5120ab-46ba-4840-8893-879d78e770ef response_code = 200 uri = /artifacts
26072025-03-04T06:08:51.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26082025-03-04T06:08:51.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1
26092025-03-04T06:08:51.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45021
26102025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26112025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26122025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26132025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26142025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26152025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26162025-03-04T06:08:51.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26172025-03-04T06:08:51.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 825 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45021 req_id = a5c3758e-edd8-4bb8-a1cf-9ad1f55c688c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26182025-03-04T06:08:51.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
26192025-03-04T06:08:51.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49966 req_id = 075e797e-a3f9-4d13-ba50-0ec07195a4c6 response_code = 204 uri = /eip-gateways
26202025-03-04T06:08:51.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212025-03-04T06:08:51.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8
26222025-03-04T06:08:51.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 954 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49966 req_id = b6387513-3f0e-4dd7-b45c-c9d6dd593fc7 response_code = 204 uri = /vpc-routes
26232025-03-04T06:08:51.126ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26242025-03-04T06:08:51.126ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0
26252025-03-04T06:08:51.153ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26262025-03-04T06:08:51.153ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b
26272025-03-04T06:08:51.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26282025-03-04T06:08:51.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b
26292025-03-04T06:08:51.195ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26302025-03-04T06:08:51.195ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_862379c5-061f-49d2-8232-148b101e17d0
26312025-03-04T06:08:51.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26322025-03-04T06:08:51.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f
26332025-03-04T06:08:51.236ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26342025-03-04T06:08:51.236ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1
26352025-03-04T06:08:51.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64890
26362025-03-04T06:08:51.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64890 req_id = c2ae1451-75b9-40b5-b0a6-1fa91d745030 response_code = 200 uri = /v2p
26372025-03-04T06:08:51.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 231209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60070 req_id = 2740f0c1-c352-46da-9e04-ffbc9279c4c0 response_code = 200 uri = /inventory
26382025-03-04T06:08:51.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45506
26392025-03-04T06:08:51.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26402025-03-04T06:08:51.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26412025-03-04T06:08:51.309ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/config/omicron-zones.json file = common/src/ledger.rs:175
26422025-03-04T06:08:51.309ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/config/omicron-zones.json file = common/src/ledger.rs:175
26432025-03-04T06:08:51.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1c45276e-4032-4af7-b0dd-228abf1563e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26442025-03-04T06:08:51.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1c45276e-4032-4af7-b0dd-228abf1563e5
26452025-03-04T06:08:51.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35607
26462025-03-04T06:08:51.329ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26472025-03-04T06:08:51.348ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15e0791a-dbe2-45e2-8a6b-a9b680c579a1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482025-03-04T06:08:51.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_15e0791a-dbe2-45e2-8a6b-a9b680c579a1
26492025-03-04T06:08:51.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26502025-03-04T06:08:51.377ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9db9576-1b14-4a9a-aee8-1f87e389a0a8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26512025-03-04T06:08:51.377ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9db9576-1b14-4a9a-aee8-1f87e389a0a8
26522025-03-04T06:08:51.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8475bc8-5d9c-4548-bd49-b09ebb09cea0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26532025-03-04T06:08:51.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f8475bc8-5d9c-4548-bd49-b09ebb09cea0
26542025-03-04T06:08:51.435ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d12ed1d5-e306-406b-af03-5a277c45ed9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552025-03-04T06:08:51.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d12ed1d5-e306-406b-af03-5a277c45ed9b
26562025-03-04T06:08:51.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35607 req_id = 84216718-83df-40cc-a494-bc455d0655ec response_code = 204 uri = /switch-ports
26572025-03-04T06:08:51.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35607 req_id = cbcbb243-d52e-4a23-96ab-667e1783a60d response_code = 200 uri = /network-bootstore-config
26582025-03-04T06:08:51.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 875c83eb-f73c-48c5-be95-6a75e92d3a3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26592025-03-04T06:08:51.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_875c83eb-f73c-48c5-be95-6a75e92d3a3b
26602025-03-04T06:08:51.482ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 862379c5-061f-49d2-8232-148b101e17d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26612025-03-04T06:08:51.482ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_862379c5-061f-49d2-8232-148b101e17d0
26622025-03-04T06:08:51.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e79c2b69-9202-4b50-ac85-c8c0095cdc1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26632025-03-04T06:08:51.503ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e79c2b69-9202-4b50-ac85-c8c0095cdc1f
26642025-03-04T06:08:51.529ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 541c11d9-c278-45bf-9ce5-5ea9028ec5b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26652025-03-04T06:08:51.530ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_541c11d9-c278-45bf-9ce5-5ea9028ec5b1
26662025-03-04T06:08:51.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232920 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45506 req_id = ca9d8418-bbe5-4697-afbd-54cc35eb732c response_code = 200 uri = /inventory
26672025-03-04T06:08:51.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53029
26682025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f54341a-27b5-4dbd-9d42-08dbeb36d2ee, kind: Service { id: facf9ba6-3984-483d-8b69-ac2385032cb0 }, name: Name("external-dns-facf9ba6-3984-483d-8b69-ac2385032cb0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6a90c4b8-61a5-4ca4-85a0-62a4d2b74b4c, kind: Service { id: de220f6c-b61b-4a8b-8e87-8ebeb727960f }, name: Name("external-dns-de220f6c-b61b-4a8b-8e87-8ebeb727960f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 73782e64-3d4e-48f5-a455-8b172e75bc34, kind: Service { id: 24f19fe8-afd8-4186-82ba-c991c9622aa1 }, name: Name("nexus-24f19fe8-afd8-4186-82ba-c991c9622aa1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aed09a16-3537-44f3-9a4e-603585b76596, kind: Service { id: 3fe4ab68-bcba-4043-bde2-b3e8e1f013ba }, name: Name("nexus-3fe4ab68-bcba-4043-bde2-b3e8e1f013ba"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 24])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d2ef9fe9-65ce-410e-b6cd-83fbf8b38306, kind: Service { id: 35d27072-44df-4fd6-866d-d1add136b456 }, name: Name("nexus-35d27072-44df-4fd6-866d-d1add136b456"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26692025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26702025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26712025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26722025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26732025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26742025-03-04T06:08:51.543ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26752025-03-04T06:08:51.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53029 req_id = 0261c0cf-2394-4326-be2d-135df7ea9d7c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26762025-03-04T06:09:00.259ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7087 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 2780ad34-eebf-4659-bad9-fc2052068fd4 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
26772025-03-04T06:09:06.213ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41438
26782025-03-04T06:09:06.213ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41438 req_id = 4b2eee4e-ddc9-4afa-b948-13a851467667 response_code = 200 uri = /baseboard
26792025-03-04T06:09:20.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33527
26802025-03-04T06:09:20.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33527 req_id = c746f66b-baf8-4a38-9a24-e8fc96fb1543 response_code = 200 uri = /vpc-routes
26812025-03-04T06:09:20.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
26822025-03-04T06:09:20.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33527 req_id = bc73cd5d-ba51-4e4f-a178-0de650f93d9a response_code = 204 uri = /eip-gateways
26832025-03-04T06:09:20.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33527 req_id = 98b78ca8-eba1-43a4-b976-b69a2dcbcc16 response_code = 204 uri = /vpc-routes
26842025-03-04T06:09:20.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51244
26852025-03-04T06:09:20.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26862025-03-04T06:09:20.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26872025-03-04T06:09:20.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51244 req_id = ea255c3d-8849-4d55-a78f-01e10fa8d8d2 response_code = 204 uri = /switch-ports
26882025-03-04T06:09:20.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47560
26892025-03-04T06:09:20.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47560 req_id = f40969de-adda-4c7a-ac4d-99f2eb459eb8 response_code = 200 uri = /v2p
26902025-03-04T06:09:20.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51244 req_id = df262436-5b7d-48c2-ba25-65e621ac7bc5 response_code = 200 uri = /network-bootstore-config
26912025-03-04T06:09:20.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40966
26922025-03-04T06:09:20.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40966 req_id = b4e8639d-581f-4d8e-bcdb-477ef800c9fb response_code = 200 uri = /vpc-routes
26932025-03-04T06:09:20.423ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
26942025-03-04T06:09:20.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40966 req_id = b13b77ac-0cd7-4cc9-be1b-fc121edff19e response_code = 204 uri = /eip-gateways
26952025-03-04T06:09:20.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40966 req_id = 8db27ddc-cf4b-4287-a999-8e387fa1222f response_code = 204 uri = /vpc-routes
26962025-03-04T06:09:20.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53333
26972025-03-04T06:09:20.460ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26982025-03-04T06:09:20.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26992025-03-04T06:09:20.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53333 req_id = 095bff87-5634-4d77-b948-3ae97956f904 response_code = 204 uri = /switch-ports
27002025-03-04T06:09:20.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42760
27012025-03-04T06:09:20.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53333 req_id = 0f2c2a4a-71c0-41af-b6db-8cfe9c3fdd0c response_code = 200 uri = /network-bootstore-config
27022025-03-04T06:09:20.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42760 req_id = 12f413ce-2ab1-4624-8c0c-2cb29e4763c4 response_code = 200 uri = /v2p
27032025-03-04T06:09:20.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47618
27042025-03-04T06:09:20.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47618 req_id = e2723e23-be8e-4d63-9152-775152b92adc response_code = 200 uri = /vpc-routes
27052025-03-04T06:09:20.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46181
27062025-03-04T06:09:20.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46181 req_id = c7a7d33d-1104-4e2e-8637-6d165889ef7b response_code = 200 uri = /v2p
27072025-03-04T06:09:20.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
27082025-03-04T06:09:20.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47618 req_id = 98ef4bfb-ecce-420f-a4d3-b156e7f2fb35 response_code = 204 uri = /eip-gateways
27092025-03-04T06:09:20.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47618 req_id = 9e7a58a4-5564-4e2b-ad4b-807eb4f008de response_code = 204 uri = /vpc-routes
27102025-03-04T06:09:20.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40611
27112025-03-04T06:09:20.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27122025-03-04T06:09:20.877ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27132025-03-04T06:09:20.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40611 req_id = 762af754-9152-4f97-9b6f-a87b165b992c response_code = 204 uri = /switch-ports
27142025-03-04T06:09:20.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40611 req_id = 7606c053-3d83-468d-a21c-4bdd7f6841c5 response_code = 200 uri = /network-bootstore-config
27152025-03-04T06:09:28.049ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
27162025-03-04T06:09:28.049ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
27172025-03-04T06:09:28.049ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
27182025-03-04T06:09:28.049ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
27192025-03-04T06:09:30.261ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8367 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = e3429151-40a6-456e-af19-749c39a9c34f response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
27202025-03-04T06:09:36.246ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62994
27212025-03-04T06:09:36.246ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62994 req_id = b6d6dd41-ac50-4cf8-b00f-2d92d7efa757 response_code = 200 uri = /baseboard
27222025-03-04T06:09:48.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60971
27232025-03-04T06:09:48.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60971 req_id = cf89ad95-a5f2-42ca-909e-7994c246a820 response_code = 200 uri = /v2p
27242025-03-04T06:09:48.580ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14832079) }
27252025-03-04T06:09:48.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60971 req_id = d14ec28d-a6c3-4d6d-aa47-9ed317821302 response_code = 204 uri = /v2p
27262025-03-04T06:09:48.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38596
27272025-03-04T06:09:48.718ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14832079))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 499ef16f-deaf-4d9c-a477-87a724c5e8a6, slot: 0, read_only: false, vcr_json: .., name: "disk-f838f41a517" }], boot_settings: Some(InstanceBootSettings { order: [499ef16f-deaf-4d9c-a477-87a724c5e8a6] }), cloud_init_bytes: Some(..) } instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d metadata = InstanceMetadata { silo_id: e4f94d8a-8452-4623-8417-67742cd92433, project_id: db387d2d-0b3f-45f8-a20d-64e110ad8029 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-04T06:09:48.710929840Z }
27282025-03-04T06:09:48.718ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d migration_id = None propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27292025-03-04T06:09:48.718ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d migration_id = None propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14832079))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0f03329f-fecf-468d-89d8-e1716cef5d25, kind: Instance { id: b0a37f87-4d2b-469c-bf01-f9e70a5b448d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14832079), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 499ef16f-deaf-4d9c-a477-87a724c5e8a6, slot: 0, read_only: false, vcr_json: .., name: "disk-f838f41a517" }], boot_settings: Some(InstanceBootSettings { order: [499ef16f-deaf-4d9c-a477-87a724c5e8a6] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-04T06:09:48.710929840Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27302025-03-04T06:09:48.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38596 req_id = acf2fdab-d0dd-4c98-83bd-f5e8dcdd2d07 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b
27312025-03-04T06:09:48.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43669
27322025-03-04T06:09:48.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43669 req_id = f00deadd-0f55-4724-9799-bbe8eb79fef1 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b/state
27332025-03-04T06:09:48.824ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14832079 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27342025-03-04T06:09:48.824ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27352025-03-04T06:09:48.861ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b file = illumos-utils/src/zone.rs:327 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27362025-03-04T06:09:48.885ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b file = illumos-utils/src/zone.rs:365 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27372025-03-04T06:09:48.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39542
27382025-03-04T06:09:48.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39542 req_id = ec3ddb1e-2fa9-4ec1-827c-d39fa5c2b0ab response_code = 200 uri = /vpc-routes
27392025-03-04T06:09:48.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {0f03329f-fecf-468d-89d8-e1716cef5d25: {10.151.2.175: {97b69b20-efa8-4097-901f-61eb43776b66}, 10.151.2.176: {97b69b20-efa8-4097-901f-61eb43776b66}}} }
27402025-03-04T06:09:50.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50994
27412025-03-04T06:09:50.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50994 req_id = 9d06fdeb-cb2e-4e4f-87ca-26aabf30667d response_code = 200 uri = /vpc-routes
27422025-03-04T06:09:50.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36338
27432025-03-04T06:09:50.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {0f03329f-fecf-468d-89d8-e1716cef5d25: {10.151.2.176: {97b69b20-efa8-4097-901f-61eb43776b66}, 10.151.2.175: {97b69b20-efa8-4097-901f-61eb43776b66}}} }
27442025-03-04T06:09:50.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50994 req_id = afe3d215-c53f-4a99-ac13-666c9c169976 response_code = 204 uri = /eip-gateways
27452025-03-04T06:09:50.477ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27462025-03-04T06:09:50.477ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b zone file = illumos-utils/src/running_zone.rs:491 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27472025-03-04T06:09:50.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38414
27482025-03-04T06:09:50.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38414 req_id = d27f7e60-9f42-4ec3-8bd4-1127d33d55c6 response_code = 200 uri = /v2p
27492025-03-04T06:09:50.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51060
27502025-03-04T06:09:50.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27512025-03-04T06:09:50.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27522025-03-04T06:09:50.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51060 req_id = b88b05f8-34f7-4bdc-bd84-b79fcc77b008 response_code = 204 uri = /switch-ports
27532025-03-04T06:09:50.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63256
27542025-03-04T06:09:50.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6959 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50994 req_id = 5e1317bb-b95a-492c-a392-08a34d2ac080 response_code = 204 uri = /vpc-routes
27552025-03-04T06:09:50.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51060 req_id = 278bc04a-f1db-4b25-ab16-42d34e080a77 response_code = 200 uri = /network-bootstore-config
27562025-03-04T06:09:50.767ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 54.564382ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27572025-03-04T06:09:50.834ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 142.11875ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27582025-03-04T06:09:50.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36576
27592025-03-04T06:09:50.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36576 req_id = d619edd9-606e-4c95-a23c-ff4696d03599 response_code = 200 uri = /v2p
27602025-03-04T06:09:50.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59744
27612025-03-04T06:09:50.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27622025-03-04T06:09:50.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27632025-03-04T06:09:51.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59744 req_id = 5200b64a-c869-4485-8e88-ba06a94c5c32 response_code = 204 uri = /switch-ports
27642025-03-04T06:09:51.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58228
27652025-03-04T06:09:51.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59744 req_id = d862da6c-adf5-4079-b000-e924e2221d03 response_code = 200 uri = /network-bootstore-config
27662025-03-04T06:09:51.113ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 298.834745ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27672025-03-04T06:09:51.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57106
27682025-03-04T06:09:51.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57106 req_id = c26b26c9-22b3-4ba4-b1a8-bd8c228b74c0 response_code = 200 uri = /vpc-routes
27692025-03-04T06:09:51.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43753
27702025-03-04T06:09:51.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43753 req_id = b70aa2c4-696a-454a-85f6-58a8b064b2b0 response_code = 200 uri = /v2p
27712025-03-04T06:09:51.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {0f03329f-fecf-468d-89d8-e1716cef5d25: {10.151.2.176: {97b69b20-efa8-4097-901f-61eb43776b66}, 10.151.2.175: {97b69b20-efa8-4097-901f-61eb43776b66}}} }
27722025-03-04T06:09:51.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57106 req_id = 3bd4d19b-5c5f-4e0d-bcdb-4749ad171cdf response_code = 204 uri = /eip-gateways
27732025-03-04T06:09:51.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57106 req_id = aaa94bb6-7765-4b5a-9854-9cc2f87be007 response_code = 204 uri = /vpc-routes
27742025-03-04T06:09:51.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49361
27752025-03-04T06:09:51.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27762025-03-04T06:09:51.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27772025-03-04T06:09:51.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49361 req_id = 2cd7d342-8b39-4b56-a3b0-3265173675af response_code = 204 uri = /switch-ports
27782025-03-04T06:09:51.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49361 req_id = a9372464-d338-4b7d-bd53-e0916820a01b response_code = 200 uri = /network-bootstore-config
27792025-03-04T06:09:51.426ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 349.825026ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27802025-03-04T06:09:51.791ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 560.153637ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27812025-03-04T06:09:52.367ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 884.626384ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27822025-03-04T06:09:53.262ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 1.234046884s file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27832025-03-04T06:09:54.507ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 1.101170176s file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27842025-03-04T06:09:55.620ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 579.410738ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b zone = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
27852025-03-04T06:09:56.230ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b file = sled-agent/src/instance.rs:2133 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27862025-03-04T06:09:56.240ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 55.000922ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27872025-03-04T06:09:56.305ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 113.842048ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27882025-03-04T06:09:56.429ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b") failed: Property not found. retry in 121.918385ms file = illumos-utils/src/svc.rs:42 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27892025-03-04T06:09:56.561ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27902025-03-04T06:09:56.600ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27912025-03-04T06:09:56.682ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27922025-03-04T06:09:56.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5577250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58228 req_id = 6cfd516f-104c-4797-b283-ea10c132d757 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b/state
27932025-03-04T06:09:56.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6368253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36338 req_id = 307fc33d-ae2d-4717-b3a3-ffe4af4a55c0 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b/state
27942025-03-04T06:09:56.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6005874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63256 req_id = 2d134de8-f90b-4c84-b1f3-c03aba87c657 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b/state
27952025-03-04T06:09:56.683ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
27962025-03-04T06:09:56.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7692243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39542 req_id = 720ea20c-4680-4b09-9fc5-a25d6a711411 response_code = 204 uri = /eip-gateways
27972025-03-04T06:09:56.684ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-04T06:09:56.684287583Z } file = sled-agent/src/instance.rs:842 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27982025-03-04T06:09:56.684ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-04T06:09:56.684287583Z } propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
27992025-03-04T06:09:56.684ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-04T06:09:56.684287583Z }, migration_in: None, migration_out: None }
28002025-03-04T06:09:56.735ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-04T06:09:56.735469110Z } file = sled-agent/src/instance.rs:842 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28012025-03-04T06:09:56.735ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-04T06:09:56.735469110Z } propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28022025-03-04T06:09:56.735ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-04T06:09:56.735469110Z }, migration_in: None, migration_out: None }
28032025-03-04T06:09:56.819ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: e497a5ee-a30f-4c93-92f5-18f7771df588, version: 3 } old_vers = RouterVersion { router_id: e497a5ee-a30f-4c93-92f5-18f7771df588, version: 3 } subnet = RouterId { vni: Vni(14832079), kind: System }
28042025-03-04T06:09:56.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39542 req_id = 95c48196-d6ba-4635-aa49-84d57e45b48d response_code = 204 uri = /vpc-routes
28052025-03-04T06:09:56.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35480
28062025-03-04T06:09:56.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35480 req_id = 4caa3031-b73c-4560-801e-f6c5c709d041 response_code = 200 uri = /vpc-routes
28072025-03-04T06:09:56.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {0f03329f-fecf-468d-89d8-e1716cef5d25: {10.151.2.175: {97b69b20-efa8-4097-901f-61eb43776b66}, 10.151.2.176: {97b69b20-efa8-4097-901f-61eb43776b66}}} }
28082025-03-04T06:09:56.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35480 req_id = 9ac666b9-2d9a-4aa2-bccf-a27bb0c9176a response_code = 204 uri = /eip-gateways
28092025-03-04T06:09:56.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35480 req_id = 1d2d9883-2752-40d9-8289-e8e8608d6d9e response_code = 204 uri = /vpc-routes
28102025-03-04T06:10:00.261ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8223 local_addr = [fd00:1122:3344:101::1]:64530 method = GET remote_addr = [fd00:1122:3344:101::d]:48281 req_id = 5064ece6-a5d1-4811-8d12-bad6d158cf01 response_code = 200 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 uri = /dbce58b0-062a-4b73-bfbe-866ce6aaea71
28112025-03-04T06:10:06.279ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43411
28122025-03-04T06:10:06.280ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43411 req_id = 2600454c-a33e-45b1-adc8-ce75a95fd30a response_code = 200 uri = /baseboard
28132025-03-04T06:10:06.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63125
28142025-03-04T06:10:06.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63125 req_id = 5ec18b1e-092f-43c3-a0a8-47c940cbd182 response_code = 200 uri = /vmms/943aafa9-d60f-4de8-9966-cb56240a1d0b/state
28152025-03-04T06:10:06.468ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-04T06:10:06.468409957Z } file = sled-agent/src/instance.rs:842 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28162025-03-04T06:10:06.468ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-04T06:10:06.468409957Z } propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28172025-03-04T06:10:06.468ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-04T06:10:06.468409957Z }, migration_in: None, migration_out: None }
28182025-03-04T06:10:06.481ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-04T06:10:06.481465096Z } file = sled-agent/src/instance.rs:842 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28192025-03-04T06:10:06.481ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-04T06:10:06.481465096Z } propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28202025-03-04T06:10:06.481ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28212025-03-04T06:10:06.481ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28222025-03-04T06:10:06.481ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28232025-03-04T06:10:06.481ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/5e143bca-8b2f-4eeb-bcf4-33d7d3a32cc3/debug/bundle/zone", "/pool/int/8bb0ee9e-3f42-456f-a81e-20fe8e95e989/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/1c45276e-4032-4af7-b0dd-228abf1563e5/crypt/debug", "/pool/ext/15e0791a-dbe2-45e2-8a6b-a9b680c579a1/crypt/debug", "/pool/ext/f9db9576-1b14-4a9a-aee8-1f87e389a0a8/crypt/debug", "/pool/ext/f8475bc8-5d9c-4548-bd49-b09ebb09cea0/crypt/debug", "/pool/ext/d12ed1d5-e306-406b-af03-5a277c45ed9b/crypt/debug", "/pool/ext/875c83eb-f73c-48c5-be95-6a75e92d3a3b/crypt/debug", "/pool/ext/862379c5-061f-49d2-8232-148b101e17d0/crypt/debug", "/pool/ext/e79c2b69-9202-4b50-ac85-c8c0095cdc1f/crypt/debug", "/pool/ext/541c11d9-c278-45bf-9ce5-5ea9028ec5b1/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b
28242025-03-04T06:10:07.112ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1144 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b", bundle_id: b0743b6a-dbb1-47a6-98c0-f490e01527f5 }, time_created: 2025-03-04T06:10:06.482420143Z, version: 0, cause: TerminatedInstance }
28252025-03-04T06:10:07.113ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_943aafa9-d60f-4de8-9966-cb56240a1d0b file = sled-agent/src/instance.rs:1376 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28262025-03-04T06:10:08.876ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:281 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28272025-03-04T06:10:08.892ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(14832079), kind: System }
28282025-03-04T06:10:08.892ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(14832079), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28292025-03-04T06:10:08.892ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-04T06:10:08.892851507Z }, migration_in: None, migration_out: None }
28302025-03-04T06:10:08.916ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-04T06:10:08.892851507Z }, migration_in: None, migration_out: None }
28312025-03-04T06:10:08.921ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = b0a37f87-4d2b-469c-bf01-f9e70a5b448d propolis_id = 943aafa9-d60f-4de8-9966-cb56240a1d0b
28322025-03-04T06:10:09.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34352
28332025-03-04T06:10:09.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34352 req_id = bbaf7c19-ca61-404b-a2c0-c2a069a6ab18 response_code = 200 uri = /vpc-routes
28342025-03-04T06:10:09.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
28352025-03-04T06:10:09.389ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71
28362025-03-04T06:10:09.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34352 req_id = 4bd9a28d-56bc-422a-8c54-b3a8523b9612 response_code = 204 uri = /eip-gateways
28372025-03-04T06:10:09.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34352 req_id = f93ad6e4-0ead-4a9c-add2-3c22cc6345bb response_code = 204 uri = /vpc-routes
28382025-03-04T06:10:09.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56642
28392025-03-04T06:10:09.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56642 req_id = c515133e-b7c9-4ccc-a537-e99996c14d6e response_code = 200 uri = /v2p
28402025-03-04T06:10:09.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40988
28412025-03-04T06:10:09.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40988 req_id = 8d36b7c3-621a-4d80-a27f-3372eac50796 response_code = 200 uri = /v2p
28422025-03-04T06:10:09.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55162
28432025-03-04T06:10:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55162 req_id = e3336c76-7a20-4ddd-bd86-048c0c1f6d03 response_code = 200 uri = /vpc-routes
28442025-03-04T06:10:09.873ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
28452025-03-04T06:10:09.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55162 req_id = fe77a005-5d2a-439e-9354-9a08f28d4b9b response_code = 204 uri = /eip-gateways
28462025-03-04T06:10:09.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55162 req_id = a9ca8844-dd8d-4f20-8479-74abde50c1ea response_code = 204 uri = /vpc-routes
28472025-03-04T06:10:10.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48774
28482025-03-04T06:10:10.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48774 req_id = e3125ebb-2aab-4d0b-9f65-7e5fa8969e13 response_code = 200 uri = /vpc-routes
28492025-03-04T06:10:10.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = dbce58b0-062a-4b73-bfbe-866ce6aaea71 values = ExternalIpGatewayMap { mappings: {} }
28502025-03-04T06:10:10.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48774 req_id = c3075d3c-bfd6-4d1e-8cea-3732b341bc56 response_code = 204 uri = /eip-gateways
28512025-03-04T06:10:10.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48774 req_id = 5161b97e-593a-4b40-8048-5f7995c1ac67 response_code = 204 uri = /vpc-routes