Max level shown:
1 [ Mar 4 03:14:44 Enabled. ]
2 [ Mar 4 03:14:44 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 4 03:14:44 Method "start" exited with status 0. ]
4 [ Mar 4 03:14:44 Rereading configuration. ]
5 [ Mar 4 03:14:44 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-04T03:14:44.915ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-04T03:14:44.915ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-03-04T03:14:44.968ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-03-04T03:14:44.968ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-04T03:14:45.082ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-04T03:14:45.091ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-04T03:14:45.099ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-03-04T03:14:45.704ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-03-04T03:14:45.842ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-03-04T03:14:45.842ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-03-04T03:14:45.842ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-03-04T03:14:45.842ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
192025-03-04T03:14:45.842ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-03-04T03:14:45.842ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-03-04T03:14:45.846ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-03-04T03:14:45.846ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-03-04T03:14:45.846ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-03-04T03:14:45.846ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
252025-03-04T03:14:45.846ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-03-04T03:14:45.846ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-03-04T03:14:45.846ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-03-04T03:14:45.846ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-03-04T03:14:45.846ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-03-04T03:14:45.857ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
312025-03-04T03:14:45.857ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool)
322025-03-04T03:14:45.956ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal }
332025-03-04T03:14:46.311ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-03-04T03:14:46.311ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-03-04T03:14:46.311ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-03-04T03:14:46.311ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-03-04T03:14:46.311ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-03-04T03:14:46.311ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-03-04T03:14:46.311ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-03-04T03:14:46.320ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
412025-03-04T03:14:46.320ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = b4fa6708-6730-444b-8f50-72671c4329fe (zpool)
422025-03-04T03:14:46.407ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal }
432025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
462025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
472025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
522025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
532025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
562025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
572025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
582025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
592025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
642025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
652025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
702025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
712025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
762025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
782025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
792025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
842025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
852025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
862025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
872025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
882025-03-04T03:14:46.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
892025-03-04T03:14:46.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-03-04T03:14:46.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-03-04T03:14:46.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-03-04T03:14:46.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-03-04T03:14:46.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
942025-03-04T03:14:46.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
952025-03-04T03:14:46.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-03-04T03:14:46.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-03-04T03:14:46.774ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-03-04T03:14:46.774ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-03-04T03:14:46.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-03-04T03:14:46.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1012025-03-04T03:14:46.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1022025-03-04T03:14:46.774ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-03-04T03:14:46.774ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1052025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1062025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1082025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1092025-03-04T03:14:46.774ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-03-04T03:14:46.774ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-03-04T03:14:46.774ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-03-04T03:14:46.785ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:795
1132025-03-04T03:14:46.786ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4060
1142025-03-04T03:14:46.786ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1399, tv_nsec: 454840408 } time_to_next_cleanup = 599.999891689s
1152025-03-04T03:14:46.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-03-04T03:14:46.786ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/sled-agent-request.json file = common/src/ledger.rs:186
1172025-03-04T03:14:46.786ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/sled-agent-request.json file = common/src/ledger.rs:186
1182025-03-04T03:14:46.789ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-03-04T03:14:46.791ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-03-04T03:14:46.791ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1191
1212025-03-04T03:14:46.791ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-03-04T03:14:46.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-03-04T03:14:46.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-03-04T03:14:46.791ZINFOSledAgent (RSS): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/rss-started.marker file = common/src/ledger.rs:186
1252025-03-04T03:14:46.791ZINFOSledAgent (RSS): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/rss-started.marker file = common/src/ledger.rs:186
1262025-03-04T03:14:46.791ZINFOSledAgent (RSS): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1272025-03-04T03:14:46.791ZINFOSledAgent (RSS): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1282025-03-04T03:14:46.791ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1240
1292025-03-04T03:14:46.791ZINFOSledAgent (RSS): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1302025-03-04T03:14:46.792ZINFOSledAgent (RSS): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1312025-03-04T03:14:46.792ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1272
1322025-03-04T03:14:46.792ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-03-04T03:14:46.792ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-03-04T03:14:46.792ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1303
1352025-03-04T03:14:46.792ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-03-04T03:14:46.792ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1372025-03-04T03:14:46.792ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1382025-03-04T03:14:46.792ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-03-04T03:14:46.792ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 5525e426-7299-43ab-ad2b-346968b24e1c (sled), rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-03-04T03:14:46.793ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4357
1412025-03-04T03:14:46.793ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4778
1422025-03-04T03:14:46.797ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-03-04T03:14:46.803ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-03-04T03:14:46.803ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-03-04T03:14:46.808ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-04T03:14:46.808ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-04T03:14:46.808ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:47177
1482025-03-04T03:14:46.808ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 5525e426-7299-43ab-ad2b-346968b24e1c (sled), rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-03-04T03:14:46.808ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-03-04T03:14:46.808ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-03-04T03:14:46.808ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1552025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1562025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1582025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1592025-03-04T03:14:46.808ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1602025-03-04T03:14:46.808ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-03-04T03:14:46.808ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-03-04T03:14:46.826ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-03-04T03:14:46.847ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:327
1642025-03-04T03:14:46.864ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:365
1652025-03-04T03:14:46.885ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1662025-03-04T03:14:46.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-03-04T03:14:46.885ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1682025-03-04T03:14:46.885ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1692025-03-04T03:14:46.888ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9f98c18e-29bc-47bc-b3ec-937bb19b8858", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9f98c18e-29bc-47bc-b3ec-937bb19b8858" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 128.436457ms
1702025-03-04T03:14:46.899ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_bf355b46-ea11-4cbf-a29a-2777749d4c54/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1712025-03-04T03:14:46.929ZINFOSledAgent: successfully created encrypted zvol: name="oxi_bf355b46-ea11-4cbf-a29a-2777749d4c54/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1722025-03-04T03:14:46.929ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_bf355b46-ea11-4cbf-a29a-2777749d4c54/swap" file = sled-agent/src/swap_device.rs:98
1732025-03-04T03:14:46.935ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1742025-03-04T03:14:46.935ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-03-04T03:14:46.935ZINFOSledAgent (BackingFs): Ensuring dataset oxi_bf355b46-ea11-4cbf-a29a-2777749d4c54/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-03-04T03:14:47.001ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-03-04T03:14:47.017ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1782025-03-04T03:14:47.017ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9cbe7901-b0f6-4202-b1bd-a707ba7c2b0d", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9cbe7901-b0f6-4202-b1bd-a707ba7c2b0d" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 68.653654ms
1792025-03-04T03:14:47.087ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1802025-03-04T03:14:47.088ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fb8f5672-364e-4501-89d8-fc2e4b88f949", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fb8f5672-364e-4501-89d8-fc2e4b88f949" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 194.286102ms
1812025-03-04T03:14:47.219ZINFOSledAgent (BackingFs): Mounting oxi_bf355b46-ea11-4cbf-a29a-2777749d4c54/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-04T03:14:47.232ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-04T03:14:47.232ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-04T03:14:47.232ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-04T03:14:47.232ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-04T03:14:47.284ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1872025-03-04T03:14:47.284ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "99d8fddc-552e-430d-99d6-d3b163bd3da7", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "99d8fddc-552e-430d-99d6-d3b163bd3da7" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 165.322308ms
1882025-03-04T03:14:47.451ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1892025-03-04T03:14:47.452ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9aa2d1c3-c880-4c6c-b591-26952870d82d", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9aa2d1c3-c880-4c6c-b591-26952870d82d" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 298.145967ms
1902025-03-04T03:14:47.751ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1912025-03-04T03:14:47.752ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f24d94bb-1b15-4015-9e2e-f7c40112bf03", "content-length": "124", "date": "Tue, 04 Mar 2025 03:14:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f24d94bb-1b15-4015-9e2e-f7c40112bf03" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 235.635925ms
1922025-03-04T03:14:47.986ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1932025-03-04T03:14:47.989ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: accfd3a5-958c-4905-8c5c-5f2ac43dda05, sled_id: 5525e426-7299-43ab-ad2b-346968b24e1c }
1942025-03-04T03:14:47.992ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:32804 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1952025-03-04T03:14:47.992ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1962025-03-04T03:14:47.992ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:32804 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 5525e426-7299-43ab-ad2b-346968b24e1c sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1972025-03-04T03:14:47.993ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 153.379545ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1982025-03-04T03:14:47.994ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
1992025-03-04T03:14:47.994ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2002025-03-04T03:14:47.994ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:979 underlay_address = fd00:1122:3344:101::1
2012025-03-04T03:14:47.994ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-03-04T03:14:48.148ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 285.949639ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2032025-03-04T03:14:48.435ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 778.552681ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2042025-03-04T03:14:49.215ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.82151562s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2052025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2789
2062025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3019
2072025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2659
2082025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2706
2092025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3100
2102025-03-04T03:14:50.905ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3145
2112025-03-04T03:14:50.907ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2927
2122025-03-04T03:14:50.908ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2700
2132025-03-04T03:14:50.909ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0d5b9f17-59fb-4052-ab9b-bff5298c23f7'/> <propval type="astring" name="rack_id" value='accfd3a5-958c-4905-8c5c-5f2ac43dda05'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fec5:6bcc'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='accfd3a5-958c-4905-8c5c-5f2ac43dda05'/> <propval type="astring" name="sled_id" value='5525e426-7299-43ab-ad2b-346968b24e1c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='accfd3a5-958c-4905-8c5c-5f2ac43dda05'/> <propval type="astring" name="sled_id" value='5525e426-7299-43ab-ad2b-346968b24e1c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='5525e426-7299-43ab-ad2b-346968b24e1c'/> <propval type="astring" name="rack_uuid" value='accfd3a5-958c-4905-8c5c-5f2ac43dda05'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='5525e426-7299-43ab-ad2b-346968b24e1c'/> <propval type="astring" name="rack_uuid" value='accfd3a5-958c-4905-8c5c-5f2ac43dda05'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-03-04T03:14:50.909ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2152025-03-04T03:14:51.039ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.185752718s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2162025-03-04T03:14:51.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 30.523203ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-04T03:14:51.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 140.655016ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-03-04T03:14:51.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 159.585629ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-03-04T03:14:51.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 459.387032ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-03-04T03:14:52.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.16299574s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-03-04T03:14:53.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.025713245s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-03-04T03:14:54.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.207024699s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-03-04T03:14:55.227ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.512697031s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2242025-03-04T03:14:56.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 937.95957ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-03-04T03:14:57.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-03-04T03:14:57.749ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2272025-03-04T03:14:57.750ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2282025-03-04T03:14:57.750ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2292025-03-04T03:14:57.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-03-04T03:14:57.750ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2312025-03-04T03:14:57.751ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2322025-03-04T03:14:57.751ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332025-03-04T03:14:57.751ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342025-03-04T03:14:57.751ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4060
2352025-03-04T03:14:57.924ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:47177
2362025-03-04T03:14:57.924ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372025-03-04T03:14:57.924ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382025-03-04T03:14:57.930ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4381 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392025-03-04T03:14:57.930ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4397
2402025-03-04T03:14:57.930ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2412025-03-04T03:14:58.140ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2422025-03-04T03:14:58.140ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2432025-03-04T03:14:58.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38142
2442025-03-04T03:14:58.167ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-03-04T03:14:58.167ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-03-04T03:14:58.167ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:186
2472025-03-04T03:14:58.167ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:186
2482025-03-04T03:14:58.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38142 req_id = 9b2e1745-4c37-414e-8f4b-c0982b195249 response_code = 200 uri = /inventory
2492025-03-04T03:14:58.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39140
2502025-03-04T03:14:58.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39140 req_id = 3abe1ec7-33ae-4b02-acb1-a2913fa9ae3c response_code = 200 uri = /sled-role
2512025-03-04T03:14:58.227ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 03218622-a8f7-4ff0-9334-14386bb2cab1 (physical_disk), pool_id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 1167fa5b-7ff7-466f-8d6a-773b18e0cb79 (physical_disk), pool_id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 44c412cb-d68d-4b70-8d03-8bd81233490b (physical_disk), pool_id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 486b5785-a056-490a-811c-63e18af836c9 (physical_disk), pool_id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 561a6dfe-5aeb-46fc-b25e-66870dd032bf (physical_disk), pool_id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 58a4834f-4b03-41fe-b8b4-1c8d7fedf3c0 (physical_disk), pool_id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 9ad724fe-8bac-48c3-9e55-a7b4ed70d210 (physical_disk), pool_id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aeab3d37-fb43-4c73-940b-3f11b745be82 (physical_disk), pool_id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: df2d57a5-8e28-40d8-bbeb-0d96a6902f17 (physical_disk), pool_id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:386 sled_address = [fd00:1122:3344:101::1]:12345
2522025-03-04T03:14:58.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38708
2532025-03-04T03:14:58.227ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2542025-03-04T03:14:58.227ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 03218622-a8f7-4ff0-9334-14386bb2cab1 (physical_disk), pool_id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 1167fa5b-7ff7-466f-8d6a-773b18e0cb79 (physical_disk), pool_id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 44c412cb-d68d-4b70-8d03-8bd81233490b (physical_disk), pool_id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 486b5785-a056-490a-811c-63e18af836c9 (physical_disk), pool_id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 561a6dfe-5aeb-46fc-b25e-66870dd032bf (physical_disk), pool_id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 58a4834f-4b03-41fe-b8b4-1c8d7fedf3c0 (physical_disk), pool_id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 9ad724fe-8bac-48c3-9e55-a7b4ed70d210 (physical_disk), pool_id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: aeab3d37-fb43-4c73-940b-3f11b745be82 (physical_disk), pool_id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: df2d57a5-8e28-40d8-bbeb-0d96a6902f17 (physical_disk), pool_id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552025-03-04T03:14:58.227ZINFOSledAgent (StorageManager): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2562025-03-04T03:14:58.227ZINFOSledAgent (StorageManager): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2572025-03-04T03:14:58.227ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1301 request = omicron_physical_disks_ensure
2582025-03-04T03:14:58.227ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592025-03-04T03:14:58.227ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602025-03-04T03:14:58.227ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612025-03-04T03:14:58.227ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622025-03-04T03:14:58.338ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2632025-03-04T03:14:58.346ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2642025-03-04T03:14:58.346ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool)
2652025-03-04T03:14:58.443ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }
2662025-03-04T03:14:58.451ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2672025-03-04T03:14:58.451ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2682025-03-04T03:14:58.451ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2692025-03-04T03:14:58.452ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2702025-03-04T03:14:58.452ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2712025-03-04T03:14:58.452ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-03-04T03:14:58.452ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2732025-03-04T03:14:58.487ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2742025-03-04T03:14:58.495ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone file = sled-storage/src/dataset.rs:304
2752025-03-04T03:14:58.629ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3 file = sled-storage/src/dataset.rs:390
2762025-03-04T03:14:58.636ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2772025-03-04T03:14:58.636ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2782025-03-04T03:14:58.636ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2792025-03-04T03:14:58.636ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2802025-03-04T03:14:58.636ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2812025-03-04T03:14:58.646ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2822025-03-04T03:14:58.646ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool)
2832025-03-04T03:14:58.740ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }
2842025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2852025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2862025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2872025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2882025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2892025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-03-04T03:14:58.747ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2912025-03-04T03:14:58.752ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
2922025-03-04T03:14:58.779ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932025-03-04T03:14:58.787ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone file = sled-storage/src/dataset.rs:304
2942025-03-04T03:14:58.914ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8bf53b00-dedd-4516-be68-25e52e3985f5 file = sled-storage/src/dataset.rs:390
2952025-03-04T03:14:58.921ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2962025-03-04T03:14:58.921ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2972025-03-04T03:14:58.921ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2982025-03-04T03:14:58.921ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2992025-03-04T03:14:58.921ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3002025-03-04T03:14:58.931ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
3012025-03-04T03:14:58.931ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool)
3022025-03-04T03:14:59.024ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }
3032025-03-04T03:14:59.032ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
3042025-03-04T03:14:59.032ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
3052025-03-04T03:14:59.032ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3062025-03-04T03:14:59.032ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3072025-03-04T03:14:59.032ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3082025-03-04T03:14:59.033ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-03-04T03:14:59.033ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3102025-03-04T03:14:59.067ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3112025-03-04T03:14:59.076ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone file = sled-storage/src/dataset.rs:304
3122025-03-04T03:14:59.218ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725 file = sled-storage/src/dataset.rs:390
3132025-03-04T03:14:59.226ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3142025-03-04T03:14:59.226ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3152025-03-04T03:14:59.226ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3162025-03-04T03:14:59.226ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3172025-03-04T03:14:59.226ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3182025-03-04T03:14:59.235ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3192025-03-04T03:14:59.235ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool)
3202025-03-04T03:14:59.330ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }
3212025-03-04T03:14:59.338ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3222025-03-04T03:14:59.338ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3232025-03-04T03:14:59.338ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3242025-03-04T03:14:59.338ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3252025-03-04T03:14:59.338ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3262025-03-04T03:14:59.339ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-03-04T03:14:59.339ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3282025-03-04T03:14:59.375ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3292025-03-04T03:14:59.383ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crypt/zone file = sled-storage/src/dataset.rs:304
3302025-03-04T03:14:59.519ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_92e4d589-1042-4d5f-a963-b670e19540f9 file = sled-storage/src/dataset.rs:390
3312025-03-04T03:14:59.527ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3322025-03-04T03:14:59.527ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3332025-03-04T03:14:59.527ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3342025-03-04T03:14:59.527ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3352025-03-04T03:14:59.527ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3362025-03-04T03:14:59.537ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3372025-03-04T03:14:59.537ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool)
3382025-03-04T03:14:59.629ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }
3392025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3402025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3412025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3422025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3432025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3442025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-03-04T03:14:59.638ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3462025-03-04T03:14:59.673ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3472025-03-04T03:14:59.681ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone file = sled-storage/src/dataset.rs:304
3482025-03-04T03:14:59.755ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
3492025-03-04T03:14:59.823ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 file = sled-storage/src/dataset.rs:390
3502025-03-04T03:14:59.831ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3512025-03-04T03:14:59.831ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3522025-03-04T03:14:59.831ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3532025-03-04T03:14:59.831ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3542025-03-04T03:14:59.831ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3552025-03-04T03:14:59.841ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3562025-03-04T03:14:59.841ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool)
3572025-03-04T03:14:59.939ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }
3582025-03-04T03:14:59.947ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3592025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3602025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3612025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3622025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3632025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-03-04T03:14:59.948ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3652025-03-04T03:14:59.984ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3662025-03-04T03:14:59.993ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone file = sled-storage/src/dataset.rs:304
3672025-03-04T03:15:00.135ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ce1d8eb5-4250-40ee-a991-35c54c086636 file = sled-storage/src/dataset.rs:390
3682025-03-04T03:15:00.144ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3692025-03-04T03:15:00.144ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3702025-03-04T03:15:00.144ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3712025-03-04T03:15:00.144ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3722025-03-04T03:15:00.144ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3732025-03-04T03:15:00.154ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3742025-03-04T03:15:00.154ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool)
3752025-03-04T03:15:00.247ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }
3762025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3772025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3782025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3792025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3802025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3812025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-03-04T03:15:00.255ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3832025-03-04T03:15:00.289ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3842025-03-04T03:15:00.297ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/zone file = sled-storage/src/dataset.rs:304
3852025-03-04T03:15:00.438ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26 file = sled-storage/src/dataset.rs:390
3862025-03-04T03:15:00.446ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3872025-03-04T03:15:00.446ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3882025-03-04T03:15:00.446ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3892025-03-04T03:15:00.446ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3902025-03-04T03:15:00.446ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3912025-03-04T03:15:00.456ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3922025-03-04T03:15:00.456ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool)
3932025-03-04T03:15:00.550ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }
3942025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3952025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3962025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3972025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3982025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3992025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-03-04T03:15:00.558ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4012025-03-04T03:15:00.595ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022025-03-04T03:15:00.602ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone file = sled-storage/src/dataset.rs:304
4032025-03-04T03:15:00.747ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797 file = sled-storage/src/dataset.rs:390
4042025-03-04T03:15:00.755ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4052025-03-04T03:15:00.755ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4062025-03-04T03:15:00.755ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4072025-03-04T03:15:00.755ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082025-03-04T03:15:00.755ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4092025-03-04T03:15:00.765ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4102025-03-04T03:15:00.765ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool)
4112025-03-04T03:15:00.863ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }
4122025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4132025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4142025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4152025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4162025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4172025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182025-03-04T03:15:00.871ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4192025-03-04T03:15:00.877ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4202025-03-04T03:15:00.917ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4212025-03-04T03:15:00.925ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone file = sled-storage/src/dataset.rs:304
4222025-03-04T03:15:01.060ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf file = sled-storage/src/dataset.rs:390
4232025-03-04T03:15:01.068ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4242025-03-04T03:15:01.068ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4252025-03-04T03:15:01.068ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4262025-03-04T03:15:01.068ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf355b46-ea11-4cbf-a29a-2777749d4c54 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b4fa6708-6730-444b-8f50-72671c4329fe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4272025-03-04T03:15:01.068ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4282025-03-04T03:15:01.068ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4292025-03-04T03:15:01.068ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4302025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4312025-03-04T03:15:01.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4322025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4332025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4342025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4352025-03-04T03:15:01.068ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4362025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4372025-03-04T03:15:01.068ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4382025-03-04T03:15:01.068ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4392025-03-04T03:15:01.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2841267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38708 req_id = a61f6288-f146-4e80-af79-d13d376202cd response_code = 200 uri = /omicron-physical-disks
4402025-03-04T03:15:01.100ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0a9814fa-caf4-4c4b-b115-6b6f35c65210 (dataset): DatasetConfig { id: 0a9814fa-caf4-4c4b-b115-6b6f35c65210 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c0dbd01-1650-459d-b607-8d007c5420e9 (dataset): DatasetConfig { id: 0c0dbd01-1650-459d-b607-8d007c5420e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ddb208a-0494-45b8-a5b8-8ec50bac5c12 (dataset): DatasetConfig { id: 0ddb208a-0494-45b8-a5b8-8ec50bac5c12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 123073a0-4ac7-43c7-aa2b-dd395f43bc31 (dataset): DatasetConfig { id: 123073a0-4ac7-43c7-aa2b-dd395f43bc31 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12f473bc-ce7b-406f-a362-e558b2fecdbb (dataset): DatasetConfig { id: 12f473bc-ce7b-406f-a362-e558b2fecdbb (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1abdd162-9cab-44c8-8d41-1bf7e01e0d7e (dataset): DatasetConfig { id: 1abdd162-9cab-44c8-8d41-1bf7e01e0d7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e1392ad-ff15-4e8e-ac5e-a2a8851c4ecc (dataset): DatasetConfig { id: 1e1392ad-ff15-4e8e-ac5e-a2a8851c4ecc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2681e31d-2630-43c7-94f9-833afbc3526a (dataset): DatasetConfig { id: 2681e31d-2630-43c7-94f9-833afbc3526a (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 296bb703-43c9-4db8-af36-d0f6ad423e53 (dataset): DatasetConfig { id: 296bb703-43c9-4db8-af36-d0f6ad423e53 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e978dd4-1a50-4f84-b34c-cba3137ce9b3 (dataset): DatasetConfig { id: 2e978dd4-1a50-4f84-b34c-cba3137ce9b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f7942b4-7d82-45b1-b519-5427899796f6 (dataset): DatasetConfig { id: 2f7942b4-7d82-45b1-b519-5427899796f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 387f557e-1773-4d55-b2f9-0ebeb4b7ee58 (dataset): DatasetConfig { id: 387f557e-1773-4d55-b2f9-0ebeb4b7ee58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46928408-5382-42ab-959d-34c769fd0ac1 (dataset): DatasetConfig { id: 46928408-5382-42ab-959d-34c769fd0ac1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f7d622a-68e0-40f9-9f38-39f470ce1b0b (dataset): DatasetConfig { id: 4f7d622a-68e0-40f9-9f38-39f470ce1b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f9e0b18-585a-4009-86c8-9dee8622f85d (dataset): DatasetConfig { id: 4f9e0b18-585a-4009-86c8-9dee8622f85d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53333e8c-61ee-4397-9bae-31e95da4e5de (dataset): DatasetConfig { id: 53333e8c-61ee-4397-9bae-31e95da4e5de (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5881cb89-6c3e-4d35-87b0-a6d817c9986f (dataset): DatasetConfig { id: 5881cb89-6c3e-4d35-87b0-a6d817c9986f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 589c648a-fba8-4b05-a6a8-021102922ba8 (dataset): DatasetConfig { id: 589c648a-fba8-4b05-a6a8-021102922ba8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60e6b3a2-dd08-4228-8752-334bd8c23d20 (dataset): DatasetConfig { id: 60e6b3a2-dd08-4228-8752-334bd8c23d20 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b3d7c99-2bda-4ebc-b012-4687659a56c7 (dataset): DatasetConfig { id: 6b3d7c99-2bda-4ebc-b012-4687659a56c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b6fbda8-be08-4354-abcc-b0f3fe76c518 (dataset): DatasetConfig { id: 6b6fbda8-be08-4354-abcc-b0f3fe76c518 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7039cc83-d585-46a6-930b-5fc4555e7d67 (dataset): DatasetConfig { id: 7039cc83-d585-46a6-930b-5fc4555e7d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7058e682-60fb-43ee-b3c7-3192b8bb9ae4 (dataset): DatasetConfig { id: 7058e682-60fb-43ee-b3c7-3192b8bb9ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7228a023-864a-41b5-86c5-6dedbe9aa555 (dataset): DatasetConfig { id: 7228a023-864a-41b5-86c5-6dedbe9aa555 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7430cf49-8c15-426b-8cea-3a70788a8f0d (dataset): DatasetConfig { id: 7430cf49-8c15-426b-8cea-3a70788a8f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74f8478f-f122-46ef-99a9-92b3ebcde04c (dataset): DatasetConfig { id: 74f8478f-f122-46ef-99a9-92b3ebcde04c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7577c601-ec30-4e6f-ac6b-fa483ada22bf (dataset): DatasetConfig { id: 7577c601-ec30-4e6f-ac6b-fa483ada22bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bcfefb2-1d41-4619-a6bb-1f04be341143 (dataset): DatasetConfig { id: 7bcfefb2-1d41-4619-a6bb-1f04be341143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 892d5d42-ded1-49b2-91a9-95ce03235164 (dataset): DatasetConfig { id: 892d5d42-ded1-49b2-91a9-95ce03235164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e28f39a-1bcd-4239-84ab-0c3946de634b (dataset): DatasetConfig { id: 8e28f39a-1bcd-4239-84ab-0c3946de634b (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9055726d-d88d-4488-b222-5740bf1c74d5 (dataset): DatasetConfig { id: 9055726d-d88d-4488-b222-5740bf1c74d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9423c456-d512-421c-9864-25f03bce7f2d (dataset): DatasetConfig { id: 9423c456-d512-421c-9864-25f03bce7f2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94287d8b-d6a7-48fe-9809-17bcb2982831 (dataset): DatasetConfig { id: 94287d8b-d6a7-48fe-9809-17bcb2982831 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9607366e-3121-4495-9119-112a544ffe48 (dataset): DatasetConfig { id: 9607366e-3121-4495-9119-112a544ffe48 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 977a3946-963b-46a7-8a59-303400301b9e (dataset): DatasetConfig { id: 977a3946-963b-46a7-8a59-303400301b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98a48613-023f-4f54-8804-9f40dd5a04c9 (dataset): DatasetConfig { id: 98a48613-023f-4f54-8804-9f40dd5a04c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a438adb-fc05-4560-9eb0-9eccbb61a12c (dataset): DatasetConfig { id: 9a438adb-fc05-4560-9eb0-9eccbb61a12c (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e88864b-c4bc-4e29-8526-b61b04da66b6 (dataset): DatasetConfig { id: 9e88864b-c4bc-4e29-8526-b61b04da66b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f557176-55e1-4721-be6f-70336e085918 (dataset): DatasetConfig { id: 9f557176-55e1-4721-be6f-70336e085918 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a32f4003-d140-4894-8393-f8563861a9d1 (dataset): DatasetConfig { id: a32f4003-d140-4894-8393-f8563861a9d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3a0ce07-3f66-4500-9f7c-489371466986 (dataset): DatasetConfig { id: a3a0ce07-3f66-4500-9f7c-489371466986 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4d82569-325c-447d-9143-ad2c1e415d05 (dataset): DatasetConfig { id: a4d82569-325c-447d-9143-ad2c1e415d05 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6e98d32-b59e-476f-b2f5-8227baa1a908 (dataset): DatasetConfig { id: a6e98d32-b59e-476f-b2f5-8227baa1a908 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae622847-fcb4-468c-b184-ccf4aebcd696 (dataset): DatasetConfig { id: ae622847-fcb4-468c-b184-ccf4aebcd696 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afbd1a3d-4101-422a-963e-a2226e6654bf (dataset): DatasetConfig { id: afbd1a3d-4101-422a-963e-a2226e6654bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8de9070-1110-45f0-b19b-ccf1329381d2 (dataset): DatasetConfig { id: b8de9070-1110-45f0-b19b-ccf1329381d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b98d95f1-e4d5-4027-85c2-58a917376975 (dataset): DatasetConfig { id: b98d95f1-e4d5-4027-85c2-58a917376975 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4501015-61d3-4b37-96a9-b4d3059816b4 (dataset): DatasetConfig { id: c4501015-61d3-4b37-96a9-b4d3059816b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c49a85b8-eb99-4979-970f-0a424c4adefe (dataset): DatasetConfig { id: c49a85b8-eb99-4979-970f-0a424c4adefe (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7b42c06-b331-4735-a2b9-99249702cb10 (dataset): DatasetConfig { id: c7b42c06-b331-4735-a2b9-99249702cb10 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cad0c716-dc39-4e07-9b7a-72b852dac4c5 (dataset): DatasetConfig { id: cad0c716-dc39-4e07-9b7a-72b852dac4c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce9e0c6d-d3b3-422d-b648-afdf55aba375 (dataset): DatasetConfig { id: ce9e0c6d-d3b3-422d-b648-afdf55aba375 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d42fc65d-6eb8-417d-ac10-6729fa2a70d6 (dataset): DatasetConfig { id: d42fc65d-6eb8-417d-ac10-6729fa2a70d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4b15bb8-ad67-458b-99f3-ae5b3e74243a (dataset): DatasetConfig { id: d4b15bb8-ad67-458b-99f3-ae5b3e74243a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d91784ec-4fd0-4f03-b178-961cb5400c86 (dataset): DatasetConfig { id: d91784ec-4fd0-4f03-b178-961cb5400c86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db27f79d-09fb-48f8-8a08-84b7654a1452 (dataset): DatasetConfig { id: db27f79d-09fb-48f8-8a08-84b7654a1452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df847020-b779-4877-8be0-6f9de3334e1d (dataset): DatasetConfig { id: df847020-b779-4877-8be0-6f9de3334e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfb80e1a-8392-47e9-ac7a-400df5a621ba (dataset): DatasetConfig { id: dfb80e1a-8392-47e9-ac7a-400df5a621ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e1328a33-b4f6-437f-b24c-3ee8396ab5ed (dataset): DatasetConfig { id: e1328a33-b4f6-437f-b24c-3ee8396ab5ed (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e56ad03e-1138-45fe-bc15-ec2a47bd4f98 (dataset): DatasetConfig { id: e56ad03e-1138-45fe-bc15-ec2a47bd4f98 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e67877d2-9f43-41ed-aca1-f2a2596fe781 (dataset): DatasetConfig { id: e67877d2-9f43-41ed-aca1-f2a2596fe781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0e20d41-5385-4ba1-b7f1-df6270db0db0 (dataset): DatasetConfig { id: f0e20d41-5385-4ba1-b7f1-df6270db0db0 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f187f13e-1cb0-41bf-98ff-3a4b89bbce7a (dataset): DatasetConfig { id: f187f13e-1cb0-41bf-98ff-3a4b89bbce7a (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2a3bd44-1f0d-4429-b8b5-a0974e29fd4a (dataset): DatasetConfig { id: f2a3bd44-1f0d-4429-b8b5-a0974e29fd4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f91828c6-268b-4c70-aa10-f0a726881c9e (dataset): DatasetConfig { id: f91828c6-268b-4c70-aa10-f0a726881c9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd7693a8-4c53-4b2d-8b71-019ea73d3495 (dataset): DatasetConfig { id: fd7693a8-4c53-4b2d-8b71-019ea73d3495 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:461 sled_address = [fd00:1122:3344:101::1]:12345
4412025-03-04T03:15:01.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39888
4422025-03-04T03:15:01.101ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4432025-03-04T03:15:01.101ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0a9814fa-caf4-4c4b-b115-6b6f35c65210 (dataset): DatasetConfig { id: 0a9814fa-caf4-4c4b-b115-6b6f35c65210 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c0dbd01-1650-459d-b607-8d007c5420e9 (dataset): DatasetConfig { id: 0c0dbd01-1650-459d-b607-8d007c5420e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ddb208a-0494-45b8-a5b8-8ec50bac5c12 (dataset): DatasetConfig { id: 0ddb208a-0494-45b8-a5b8-8ec50bac5c12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 123073a0-4ac7-43c7-aa2b-dd395f43bc31 (dataset): DatasetConfig { id: 123073a0-4ac7-43c7-aa2b-dd395f43bc31 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12f473bc-ce7b-406f-a362-e558b2fecdbb (dataset): DatasetConfig { id: 12f473bc-ce7b-406f-a362-e558b2fecdbb (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1abdd162-9cab-44c8-8d41-1bf7e01e0d7e (dataset): DatasetConfig { id: 1abdd162-9cab-44c8-8d41-1bf7e01e0d7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e1392ad-ff15-4e8e-ac5e-a2a8851c4ecc (dataset): DatasetConfig { id: 1e1392ad-ff15-4e8e-ac5e-a2a8851c4ecc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2681e31d-2630-43c7-94f9-833afbc3526a (dataset): DatasetConfig { id: 2681e31d-2630-43c7-94f9-833afbc3526a (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 296bb703-43c9-4db8-af36-d0f6ad423e53 (dataset): DatasetConfig { id: 296bb703-43c9-4db8-af36-d0f6ad423e53 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e978dd4-1a50-4f84-b34c-cba3137ce9b3 (dataset): DatasetConfig { id: 2e978dd4-1a50-4f84-b34c-cba3137ce9b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f7942b4-7d82-45b1-b519-5427899796f6 (dataset): DatasetConfig { id: 2f7942b4-7d82-45b1-b519-5427899796f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 387f557e-1773-4d55-b2f9-0ebeb4b7ee58 (dataset): DatasetConfig { id: 387f557e-1773-4d55-b2f9-0ebeb4b7ee58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46928408-5382-42ab-959d-34c769fd0ac1 (dataset): DatasetConfig { id: 46928408-5382-42ab-959d-34c769fd0ac1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f7d622a-68e0-40f9-9f38-39f470ce1b0b (dataset): DatasetConfig { id: 4f7d622a-68e0-40f9-9f38-39f470ce1b0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f9e0b18-585a-4009-86c8-9dee8622f85d (dataset): DatasetConfig { id: 4f9e0b18-585a-4009-86c8-9dee8622f85d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53333e8c-61ee-4397-9bae-31e95da4e5de (dataset): DatasetConfig { id: 53333e8c-61ee-4397-9bae-31e95da4e5de (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5881cb89-6c3e-4d35-87b0-a6d817c9986f (dataset): DatasetConfig { id: 5881cb89-6c3e-4d35-87b0-a6d817c9986f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 589c648a-fba8-4b05-a6a8-021102922ba8 (dataset): DatasetConfig { id: 589c648a-fba8-4b05-a6a8-021102922ba8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60e6b3a2-dd08-4228-8752-334bd8c23d20 (dataset): DatasetConfig { id: 60e6b3a2-dd08-4228-8752-334bd8c23d20 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b3d7c99-2bda-4ebc-b012-4687659a56c7 (dataset): DatasetConfig { id: 6b3d7c99-2bda-4ebc-b012-4687659a56c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b6fbda8-be08-4354-abcc-b0f3fe76c518 (dataset): DatasetConfig { id: 6b6fbda8-be08-4354-abcc-b0f3fe76c518 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7039cc83-d585-46a6-930b-5fc4555e7d67 (dataset): DatasetConfig { id: 7039cc83-d585-46a6-930b-5fc4555e7d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7058e682-60fb-43ee-b3c7-3192b8bb9ae4 (dataset): DatasetConfig { id: 7058e682-60fb-43ee-b3c7-3192b8bb9ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7228a023-864a-41b5-86c5-6dedbe9aa555 (dataset): DatasetConfig { id: 7228a023-864a-41b5-86c5-6dedbe9aa555 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7430cf49-8c15-426b-8cea-3a70788a8f0d (dataset): DatasetConfig { id: 7430cf49-8c15-426b-8cea-3a70788a8f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74f8478f-f122-46ef-99a9-92b3ebcde04c (dataset): DatasetConfig { id: 74f8478f-f122-46ef-99a9-92b3ebcde04c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7577c601-ec30-4e6f-ac6b-fa483ada22bf (dataset): DatasetConfig { id: 7577c601-ec30-4e6f-ac6b-fa483ada22bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bcfefb2-1d41-4619-a6bb-1f04be341143 (dataset): DatasetConfig { id: 7bcfefb2-1d41-4619-a6bb-1f04be341143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 892d5d42-ded1-49b2-91a9-95ce03235164 (dataset): DatasetConfig { id: 892d5d42-ded1-49b2-91a9-95ce03235164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e28f39a-1bcd-4239-84ab-0c3946de634b (dataset): DatasetConfig { id: 8e28f39a-1bcd-4239-84ab-0c3946de634b (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9055726d-d88d-4488-b222-5740bf1c74d5 (dataset): DatasetConfig { id: 9055726d-d88d-4488-b222-5740bf1c74d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9423c456-d512-421c-9864-25f03bce7f2d (dataset): DatasetConfig { id: 9423c456-d512-421c-9864-25f03bce7f2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94287d8b-d6a7-48fe-9809-17bcb2982831 (dataset): DatasetConfig { id: 94287d8b-d6a7-48fe-9809-17bcb2982831 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9607366e-3121-4495-9119-112a544ffe48 (dataset): DatasetConfig { id: 9607366e-3121-4495-9119-112a544ffe48 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 977a3946-963b-46a7-8a59-303400301b9e (dataset): DatasetConfig { id: 977a3946-963b-46a7-8a59-303400301b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98a48613-023f-4f54-8804-9f40dd5a04c9 (dataset): DatasetConfig { id: 98a48613-023f-4f54-8804-9f40dd5a04c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a438adb-fc05-4560-9eb0-9eccbb61a12c (dataset): DatasetConfig { id: 9a438adb-fc05-4560-9eb0-9eccbb61a12c (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e88864b-c4bc-4e29-8526-b61b04da66b6 (dataset): DatasetConfig { id: 9e88864b-c4bc-4e29-8526-b61b04da66b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f557176-55e1-4721-be6f-70336e085918 (dataset): DatasetConfig { id: 9f557176-55e1-4721-be6f-70336e085918 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a32f4003-d140-4894-8393-f8563861a9d1 (dataset): DatasetConfig { id: a32f4003-d140-4894-8393-f8563861a9d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3a0ce07-3f66-4500-9f7c-489371466986 (dataset): DatasetConfig { id: a3a0ce07-3f66-4500-9f7c-489371466986 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4d82569-325c-447d-9143-ad2c1e415d05 (dataset): DatasetConfig { id: a4d82569-325c-447d-9143-ad2c1e415d05 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6e98d32-b59e-476f-b2f5-8227baa1a908 (dataset): DatasetConfig { id: a6e98d32-b59e-476f-b2f5-8227baa1a908 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae622847-fcb4-468c-b184-ccf4aebcd696 (dataset): DatasetConfig { id: ae622847-fcb4-468c-b184-ccf4aebcd696 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afbd1a3d-4101-422a-963e-a2226e6654bf (dataset): DatasetConfig { id: afbd1a3d-4101-422a-963e-a2226e6654bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8de9070-1110-45f0-b19b-ccf1329381d2 (dataset): DatasetConfig { id: b8de9070-1110-45f0-b19b-ccf1329381d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b98d95f1-e4d5-4027-85c2-58a917376975 (dataset): DatasetConfig { id: b98d95f1-e4d5-4027-85c2-58a917376975 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4501015-61d3-4b37-96a9-b4d3059816b4 (dataset): DatasetConfig { id: c4501015-61d3-4b37-96a9-b4d3059816b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c49a85b8-eb99-4979-970f-0a424c4adefe (dataset): DatasetConfig { id: c49a85b8-eb99-4979-970f-0a424c4adefe (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7b42c06-b331-4735-a2b9-99249702cb10 (dataset): DatasetConfig { id: c7b42c06-b331-4735-a2b9-99249702cb10 (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cad0c716-dc39-4e07-9b7a-72b852dac4c5 (dataset): DatasetConfig { id: cad0c716-dc39-4e07-9b7a-72b852dac4c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce9e0c6d-d3b3-422d-b648-afdf55aba375 (dataset): DatasetConfig { id: ce9e0c6d-d3b3-422d-b648-afdf55aba375 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d42fc65d-6eb8-417d-ac10-6729fa2a70d6 (dataset): DatasetConfig { id: d42fc65d-6eb8-417d-ac10-6729fa2a70d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4b15bb8-ad67-458b-99f3-ae5b3e74243a (dataset): DatasetConfig { id: d4b15bb8-ad67-458b-99f3-ae5b3e74243a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d91784ec-4fd0-4f03-b178-961cb5400c86 (dataset): DatasetConfig { id: d91784ec-4fd0-4f03-b178-961cb5400c86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db27f79d-09fb-48f8-8a08-84b7654a1452 (dataset): DatasetConfig { id: db27f79d-09fb-48f8-8a08-84b7654a1452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df847020-b779-4877-8be0-6f9de3334e1d (dataset): DatasetConfig { id: df847020-b779-4877-8be0-6f9de3334e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfb80e1a-8392-47e9-ac7a-400df5a621ba (dataset): DatasetConfig { id: dfb80e1a-8392-47e9-ac7a-400df5a621ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e1328a33-b4f6-437f-b24c-3ee8396ab5ed (dataset): DatasetConfig { id: e1328a33-b4f6-437f-b24c-3ee8396ab5ed (dataset), name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e56ad03e-1138-45fe-bc15-ec2a47bd4f98 (dataset): DatasetConfig { id: e56ad03e-1138-45fe-bc15-ec2a47bd4f98 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e67877d2-9f43-41ed-aca1-f2a2596fe781 (dataset): DatasetConfig { id: e67877d2-9f43-41ed-aca1-f2a2596fe781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0e20d41-5385-4ba1-b7f1-df6270db0db0 (dataset): DatasetConfig { id: f0e20d41-5385-4ba1-b7f1-df6270db0db0 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f187f13e-1cb0-41bf-98ff-3a4b89bbce7a (dataset): DatasetConfig { id: f187f13e-1cb0-41bf-98ff-3a4b89bbce7a (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2a3bd44-1f0d-4429-b8b5-a0974e29fd4a (dataset): DatasetConfig { id: f2a3bd44-1f0d-4429-b8b5-a0974e29fd4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f91828c6-268b-4c70-aa10-f0a726881c9e (dataset): DatasetConfig { id: f91828c6-268b-4c70-aa10-f0a726881c9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd7693a8-4c53-4b2d-8b71-019ea73d3495 (dataset): DatasetConfig { id: fd7693a8-4c53-4b2d-8b71-019ea73d3495 (dataset), name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4442025-03-04T03:15:01.101ZINFOSledAgent (StorageManager): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4452025-03-04T03:15:01.101ZINFOSledAgent (StorageManager): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4462025-03-04T03:15:01.101ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4472025-03-04T03:15:01.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4482025-03-04T03:15:01.116ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4492025-03-04T03:15:01.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d" } file = sled-storage/src/manager.rs:1433
4502025-03-04T03:15:01.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4512025-03-04T03:15:01.175ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4522025-03-04T03:15:01.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4532025-03-04T03:15:01.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4542025-03-04T03:15:01.225ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4552025-03-04T03:15:01.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941" } file = sled-storage/src/manager.rs:1433
4562025-03-04T03:15:01.282ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4572025-03-04T03:15:01.283ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4582025-03-04T03:15:01.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone" } file = sled-storage/src/manager.rs:1433
4592025-03-04T03:15:01.311ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4602025-03-04T03:15:01.311ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4612025-03-04T03:15:01.311ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone/oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8"), full_name: "oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone/oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8" } file = sled-storage/src/manager.rs:1433
4622025-03-04T03:15:01.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4632025-03-04T03:15:01.369ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4642025-03-04T03:15:01.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a" } file = sled-storage/src/manager.rs:1433
4652025-03-04T03:15:01.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4662025-03-04T03:15:01.428ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4672025-03-04T03:15:01.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c" } file = sled-storage/src/manager.rs:1433
4682025-03-04T03:15:01.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4692025-03-04T03:15:01.487ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4702025-03-04T03:15:01.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92e4d589-1042-4d5f-a963-b670e19540f9/crypt/zone"), full_name: "oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crypt/zone" } file = sled-storage/src/manager.rs:1433
4712025-03-04T03:15:01.516ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-04T03:15:01.516ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4732025-03-04T03:15:01.516ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
4742025-03-04T03:15:01.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-04T03:15:01.564ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4762025-03-04T03:15:01.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92e4d589-1042-4d5f-a963-b670e19540f9/crypt/zone/oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1"), full_name: "oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crypt/zone/oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1" } file = sled-storage/src/manager.rs:1433
4772025-03-04T03:15:01.621ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-04T03:15:01.621ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4792025-03-04T03:15:01.621ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/debug"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/debug" } file = sled-storage/src/manager.rs:1433
4802025-03-04T03:15:01.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4812025-03-04T03:15:01.649ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4822025-03-04T03:15:01.650ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone" } file = sled-storage/src/manager.rs:1433
4832025-03-04T03:15:01.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4842025-03-04T03:15:01.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4852025-03-04T03:15:01.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crucible" } file = sled-storage/src/manager.rs:1433
4862025-03-04T03:15:01.727ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-04T03:15:01.727ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4882025-03-04T03:15:01.727ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/debug"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/debug" } file = sled-storage/src/manager.rs:1433
4892025-03-04T03:15:01.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-04T03:15:01.754ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4912025-03-04T03:15:01.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b" } file = sled-storage/src/manager.rs:1433
4922025-03-04T03:15:01.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-04T03:15:01.813ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4942025-03-04T03:15:01.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4952025-03-04T03:15:01.861ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-04T03:15:01.861ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4972025-03-04T03:15:01.861ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11" } file = sled-storage/src/manager.rs:1433
4982025-03-04T03:15:01.879ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
4992025-03-04T03:15:01.920ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5002025-03-04T03:15:01.920ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5012025-03-04T03:15:01.920ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95" } file = sled-storage/src/manager.rs:1433
5022025-03-04T03:15:01.978ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5032025-03-04T03:15:01.978ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5042025-03-04T03:15:01.978ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5052025-03-04T03:15:02.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5062025-03-04T03:15:02.029ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5072025-03-04T03:15:02.029ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crucible" } file = sled-storage/src/manager.rs:1433
5082025-03-04T03:15:02.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5092025-03-04T03:15:02.078ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5102025-03-04T03:15:02.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92e4d589-1042-4d5f-a963-b670e19540f9/crypt/debug"), full_name: "oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crypt/debug" } file = sled-storage/src/manager.rs:1433
5112025-03-04T03:15:02.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5122025-03-04T03:15:02.108ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5132025-03-04T03:15:02.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/debug"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/debug" } file = sled-storage/src/manager.rs:1433
5142025-03-04T03:15:02.137ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5152025-03-04T03:15:02.137ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5162025-03-04T03:15:02.137ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crucible" } file = sled-storage/src/manager.rs:1433
5172025-03-04T03:15:02.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5182025-03-04T03:15:02.185ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5192025-03-04T03:15:02.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd" } file = sled-storage/src/manager.rs:1433
5202025-03-04T03:15:02.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5212025-03-04T03:15:02.244ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5222025-03-04T03:15:02.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24" } file = sled-storage/src/manager.rs:1433
5232025-03-04T03:15:02.305ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5242025-03-04T03:15:02.305ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5252025-03-04T03:15:02.305ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/zone/oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3"), full_name: "oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/zone/oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3" } file = sled-storage/src/manager.rs:1433
5262025-03-04T03:15:02.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5272025-03-04T03:15:02.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5282025-03-04T03:15:02.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e" } file = sled-storage/src/manager.rs:1433
5292025-03-04T03:15:02.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5302025-03-04T03:15:02.423ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5312025-03-04T03:15:02.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone" } file = sled-storage/src/manager.rs:1433
5322025-03-04T03:15:02.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5332025-03-04T03:15:02.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5342025-03-04T03:15:02.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6" } file = sled-storage/src/manager.rs:1433
5352025-03-04T03:15:02.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5362025-03-04T03:15:02.512ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5372025-03-04T03:15:02.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crucible" } file = sled-storage/src/manager.rs:1433
5382025-03-04T03:15:02.558ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5392025-03-04T03:15:02.558ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5402025-03-04T03:15:02.558ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/zone"), full_name: "oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/zone" } file = sled-storage/src/manager.rs:1433
5412025-03-04T03:15:02.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5422025-03-04T03:15:02.586ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5432025-03-04T03:15:02.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5" } file = sled-storage/src/manager.rs:1433
5442025-03-04T03:15:02.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5452025-03-04T03:15:02.645ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5462025-03-04T03:15:02.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crucible" } file = sled-storage/src/manager.rs:1433
5472025-03-04T03:15:02.693ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5482025-03-04T03:15:02.693ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5492025-03-04T03:15:02.693ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2" } file = sled-storage/src/manager.rs:1433
5502025-03-04T03:15:02.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5512025-03-04T03:15:02.754ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5522025-03-04T03:15:02.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7" } file = sled-storage/src/manager.rs:1433
5532025-03-04T03:15:02.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5542025-03-04T03:15:02.814ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5552025-03-04T03:15:02.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crucible" } file = sled-storage/src/manager.rs:1433
5562025-03-04T03:15:02.863ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5572025-03-04T03:15:02.863ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5582025-03-04T03:15:02.863ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5592025-03-04T03:15:02.881ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
5602025-03-04T03:15:02.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5612025-03-04T03:15:02.913ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5622025-03-04T03:15:02.913ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89" } file = sled-storage/src/manager.rs:1433
5632025-03-04T03:15:02.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5642025-03-04T03:15:02.972ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5652025-03-04T03:15:02.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80"), full_name: "oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/zone/oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80" } file = sled-storage/src/manager.rs:1433
5662025-03-04T03:15:03.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5672025-03-04T03:15:03.032ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5682025-03-04T03:15:03.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/zone/oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d" } file = sled-storage/src/manager.rs:1433
5692025-03-04T03:15:03.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5702025-03-04T03:15:03.094ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5712025-03-04T03:15:03.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crucible" } file = sled-storage/src/manager.rs:1433
5722025-03-04T03:15:03.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5732025-03-04T03:15:03.143ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5742025-03-04T03:15:03.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/debug"), full_name: "oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/debug" } file = sled-storage/src/manager.rs:1433
5752025-03-04T03:15:03.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5762025-03-04T03:15:03.172ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5772025-03-04T03:15:03.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone/oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), full_name: "oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone/oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5" } file = sled-storage/src/manager.rs:1433
5782025-03-04T03:15:03.231ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5792025-03-04T03:15:03.231ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5802025-03-04T03:15:03.231ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/zone/oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7" } file = sled-storage/src/manager.rs:1433
5812025-03-04T03:15:03.293ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5822025-03-04T03:15:03.293ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5832025-03-04T03:15:03.293ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/debug"), full_name: "oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/debug" } file = sled-storage/src/manager.rs:1433
5842025-03-04T03:15:03.324ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5852025-03-04T03:15:03.324ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5862025-03-04T03:15:03.324ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882" } file = sled-storage/src/manager.rs:1433
5872025-03-04T03:15:03.386ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5882025-03-04T03:15:03.386ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5892025-03-04T03:15:03.386ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331" } file = sled-storage/src/manager.rs:1433
5902025-03-04T03:15:03.448ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5912025-03-04T03:15:03.448ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5922025-03-04T03:15:03.448ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5932025-03-04T03:15:03.499ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5942025-03-04T03:15:03.499ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5952025-03-04T03:15:03.499ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crucible" } file = sled-storage/src/manager.rs:1433
5962025-03-04T03:15:03.547ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5972025-03-04T03:15:03.547ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5982025-03-04T03:15:03.547ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone"), full_name: "oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/zone" } file = sled-storage/src/manager.rs:1433
5992025-03-04T03:15:03.577ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6002025-03-04T03:15:03.577ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6012025-03-04T03:15:03.577ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
6022025-03-04T03:15:03.627ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6032025-03-04T03:15:03.627ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6042025-03-04T03:15:03.627ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone" } file = sled-storage/src/manager.rs:1433
6052025-03-04T03:15:03.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6062025-03-04T03:15:03.657ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6072025-03-04T03:15:03.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone/oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30" } file = sled-storage/src/manager.rs:1433
6082025-03-04T03:15:03.717ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6092025-03-04T03:15:03.717ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6102025-03-04T03:15:03.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/clickhouse" } file = sled-storage/src/manager.rs:1433
6112025-03-04T03:15:03.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6122025-03-04T03:15:03.767ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6132025-03-04T03:15:03.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone"), full_name: "oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/zone" } file = sled-storage/src/manager.rs:1433
6142025-03-04T03:15:03.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6152025-03-04T03:15:03.797ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6162025-03-04T03:15:03.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/zone/oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e" } file = sled-storage/src/manager.rs:1433
6172025-03-04T03:15:03.856ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6182025-03-04T03:15:03.856ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6192025-03-04T03:15:03.856ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6202025-03-04T03:15:03.884ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
6212025-03-04T03:15:03.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6222025-03-04T03:15:03.908ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6232025-03-04T03:15:03.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/debug"), full_name: "oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/debug" } file = sled-storage/src/manager.rs:1433
6242025-03-04T03:15:03.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6252025-03-04T03:15:03.938ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6262025-03-04T03:15:03.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crucible" } file = sled-storage/src/manager.rs:1433
6272025-03-04T03:15:03.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6282025-03-04T03:15:03.986ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6292025-03-04T03:15:03.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/debug"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/debug" } file = sled-storage/src/manager.rs:1433
6302025-03-04T03:15:04.017ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6312025-03-04T03:15:04.017ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6322025-03-04T03:15:04.017ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6332025-03-04T03:15:04.068ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6342025-03-04T03:15:04.068ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6352025-03-04T03:15:04.068ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8" } file = sled-storage/src/manager.rs:1433
6362025-03-04T03:15:04.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6372025-03-04T03:15:04.130ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6382025-03-04T03:15:04.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone" } file = sled-storage/src/manager.rs:1433
6392025-03-04T03:15:04.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6402025-03-04T03:15:04.159ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6412025-03-04T03:15:04.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
6422025-03-04T03:15:04.209ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6432025-03-04T03:15:04.209ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6442025-03-04T03:15:04.209ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/debug"), full_name: "oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/debug" } file = sled-storage/src/manager.rs:1433
6452025-03-04T03:15:04.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6462025-03-04T03:15:04.239ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6472025-03-04T03:15:04.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762"), full_name: "oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/zone/oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762" } file = sled-storage/src/manager.rs:1433
6482025-03-04T03:15:04.300ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6492025-03-04T03:15:04.301ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6502025-03-04T03:15:04.301ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
6512025-03-04T03:15:04.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3200642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39888 req_id = 8c23bd2a-5a18-4e12-b51e-83e5cf83bfb0 response_code = 200 uri = /datasets
6522025-03-04T03:15:04.333ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 99798c93-1ef2-44fb-9fde-7dd780a62a5e (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 13b4e778-1c69-4f32-9182-d8fdea8251cd (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: a5620ef8-a00b-4ddd-8732-aebedbdd8941 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
6532025-03-04T03:15:04.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55440
6542025-03-04T03:15:04.333ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6552025-03-04T03:15:04.333ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6562025-03-04T03:15:04.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-03-04T03:15:04.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-03-04T03:15:04.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-03-04T03:15:04.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-03-04T03:15:04.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-03-04T03:15:04.360ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:186
6622025-03-04T03:15:04.360ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:186
6632025-03-04T03:15:04.360ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4975 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6642025-03-04T03:15:04.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-03-04T03:15:04.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-03-04T03:15:04.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-03-04T03:15:04.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-03-04T03:15:04.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd file = illumos-utils/src/zone.rs:327
6692025-03-04T03:15:04.462ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941 file = illumos-utils/src/zone.rs:327
6702025-03-04T03:15:04.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e file = illumos-utils/src/zone.rs:327
6712025-03-04T03:15:04.478ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd file = illumos-utils/src/zone.rs:365
6722025-03-04T03:15:04.482ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941 file = illumos-utils/src/zone.rs:365
6732025-03-04T03:15:04.486ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e file = illumos-utils/src/zone.rs:365
6742025-03-04T03:15:04.887ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/probe_manager.rs:234 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
6752025-03-04T03:15:06.099ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762025-03-04T03:15:06.575ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772025-03-04T03:15:06.575ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1068 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6782025-03-04T03:15:07.056ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1068 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6792025-03-04T03:15:07.056ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-03-04T03:15:07.056ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1068 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812025-03-04T03:15:07.056ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
6822025-03-04T03:15:07.061ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
6832025-03-04T03:15:07.065ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
6842025-03-04T03:15:07.194ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 32.437961ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
6852025-03-04T03:15:07.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 63.521568ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
6862025-03-04T03:15:07.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 69.181108ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
6872025-03-04T03:15:07.234ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4405
6882025-03-04T03:15:07.234ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4415 gateway = fd00:1122:3344:101::1
6892025-03-04T03:15:07.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 115.091847ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
6902025-03-04T03:15:07.241ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4429 gateway = fd00:1122:3344:101::1
6912025-03-04T03:15:07.241ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4494
6922025-03-04T03:15:07.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 86.307914ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
6932025-03-04T03:15:07.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 73.850358ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
6942025-03-04T03:15:07.724ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
6952025-03-04T03:15:07.724ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
6962025-03-04T03:15:07.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 117.827356ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
6972025-03-04T03:15:07.811ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 259.300375ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
6982025-03-04T03:15:07.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 107.790804ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
6992025-03-04T03:15:07.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 422.749799ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7002025-03-04T03:15:07.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 501.152911ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7012025-03-04T03:15:08.069ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4535
7022025-03-04T03:15:08.069ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4568
7032025-03-04T03:15:08.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 207.705824ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7042025-03-04T03:15:08.124ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4581
7052025-03-04T03:15:08.124ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4446
7062025-03-04T03:15:08.142ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
7072025-03-04T03:15:08.142ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
7082025-03-04T03:15:08.186ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4488
7092025-03-04T03:15:08.186ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4545 rack_subnet = fd00:1122:3344::
7102025-03-04T03:15:08.210ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4556
7112025-03-04T03:15:08.210ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4638
7122025-03-04T03:15:08.286ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4670
7132025-03-04T03:15:08.286ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4676
7142025-03-04T03:15:08.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 582.372341ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7152025-03-04T03:15:08.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 973.148524ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7162025-03-04T03:15:08.383ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4717
7172025-03-04T03:15:08.383ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4587
7182025-03-04T03:15:08.483ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4620
7192025-03-04T03:15:08.483ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7202025-03-04T03:15:08.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 912.779682ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7212025-03-04T03:15:08.518ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/5525e426-7299-43ab-ad2b-346968b24e1c) file = sled-agent/src/nexus.rs:530 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
7222025-03-04T03:15:08.519ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7232025-03-04T03:15:08.551ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7242025-03-04T03:15:08.551ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7252025-03-04T03:15:08.551ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7262025-03-04T03:15:08.551ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7272025-03-04T03:15:08.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
7282025-03-04T03:15:08.640ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7292025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7302025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7312025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7322025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7332025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7342025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7352025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7362025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7372025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7382025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7392025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7402025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7412025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7422025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7432025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7442025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7452025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7462025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7472025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7482025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7492025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7502025-03-04T03:15:08.640ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7512025-03-04T03:15:08.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 1.170342462s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7522025-03-04T03:15:09.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 715.608106ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7532025-03-04T03:15:09.425ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 855.429027ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7542025-03-04T03:15:10.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 1.168210358s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7552025-03-04T03:15:10.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 503.049335ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7562025-03-04T03:15:10.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 1.30324029s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7572025-03-04T03:15:10.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 791.842192ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7582025-03-04T03:15:11.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e") failed: Property not found. retry in 1.296268248s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7592025-03-04T03:15:11.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd") failed: Property not found. retry in 1.052978458s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7602025-03-04T03:15:11.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941") failed: Property not found. retry in 1.428210546s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7612025-03-04T03:15:13.048ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_internal_dns_13b4e778-1c69-4f32-9182-d8fdea8251cd
7622025-03-04T03:15:13.048ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_internal_dns_a5620ef8-a00b-4ddd-8732-aebedbdd8941
7632025-03-04T03:15:13.048ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_internal_dns_99798c93-1ef2-44fb-9fde-7dd780a62a5e
7642025-03-04T03:15:13.048ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7652025-03-04T03:15:13.048ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7662025-03-04T03:15:13.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8715339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55440 req_id = 09bfcd62-a535-4710-989c-c48c7c7af16e response_code = 204 uri = /omicron-zones
7672025-03-04T03:15:13.051ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7682025-03-04T03:15:14.228ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7692025-03-04T03:15:14.288ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7702025-03-04T03:15:14.337ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:695
7712025-03-04T03:15:14.337ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7722025-03-04T03:15:14.368ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7732025-03-04T03:15:14.369ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7742025-03-04T03:15:14.369ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7752025-03-04T03:15:14.398ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 99798c93-1ef2-44fb-9fde-7dd780a62a5e (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 13b4e778-1c69-4f32-9182-d8fdea8251cd (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: a5620ef8-a00b-4ddd-8732-aebedbdd8941 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 (service), filesystem_pool: Some(ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0c4f229a-6961-4c6d-935f-c5ffbe7f7b53, kind: Service { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 }, name: Name("ntp-92dd4a5d-701b-4209-bc9d-49a6c4a9cc89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
7762025-03-04T03:15:14.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42645
7772025-03-04T03:15:14.398ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-03-04T03:15:14.398ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-03-04T03:15:14.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-03-04T03:15:14.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-03-04T03:15:14.422ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-03-04T03:15:14.422ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-03-04T03:15:14.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-03-04T03:15:14.433ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
7852025-03-04T03:15:14.433ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
7862025-03-04T03:15:14.433ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4975 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7872025-03-04T03:15:14.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882025-03-04T03:15:14.444ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892025-03-04T03:15:14.476ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902025-03-04T03:15:14.477ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912025-03-04T03:15:14.477ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922025-03-04T03:15:14.506ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 250, 48]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932025-03-04T03:15:14.506ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = boundary_ntp
7942025-03-04T03:15:14.507ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7952025-03-04T03:15:14.507ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7962025-03-04T03:15:14.507ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7972025-03-04T03:15:14.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982025-03-04T03:15:14.532ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 file = illumos-utils/src/zone.rs:327
7992025-03-04T03:15:14.549ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 file = illumos-utils/src/zone.rs:365
8002025-03-04T03:15:15.205ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012025-03-04T03:15:15.205ZINFOSledAgent (ServiceManager): Booting oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8022025-03-04T03:15:15.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 58.110341ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8032025-03-04T03:15:15.415ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 77.698867ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8042025-03-04T03:15:15.504ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 108.535843ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8052025-03-04T03:15:15.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 206.121877ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8062025-03-04T03:15:15.840ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 986.412395ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8072025-03-04T03:15:16.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 830.020801ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8082025-03-04T03:15:17.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 1.297842533s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8092025-03-04T03:15:17.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8102025-03-04T03:15:17.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8112025-03-04T03:15:18.144ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8122025-03-04T03:15:18.144ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8132025-03-04T03:15:18.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 908.186061ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8142025-03-04T03:15:19.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89") failed: Property not found. retry in 1.433225153s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8152025-03-04T03:15:21.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89
8162025-03-04T03:15:21.357ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8172025-03-04T03:15:21.357ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8182025-03-04T03:15:21.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6959648 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42645 req_id = 1b1baca4-e31e-4a7e-a8ae-bdb8918931ea response_code = 204 uri = /omicron-zones
8192025-03-04T03:15:21.360ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:736
8202025-03-04T03:15:21.390ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8212025-03-04T03:15:21.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62569
8222025-03-04T03:15:21.399ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4013
8232025-03-04T03:15:21.399ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62569 req_id = 295e90b5-7657-41fd-9ba2-e1153bad6e62 response_code = 500 uri = /timesync
8242025-03-04T03:15:21.401ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8252025-03-04T03:15:21.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8262025-03-04T03:15:21.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43355
8272025-03-04T03:15:22.461ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8282025-03-04T03:15:22.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8292025-03-04T03:15:23.051ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8302025-03-04T03:15:25.548ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4013
8312025-03-04T03:15:25.548ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43355 req_id = 5face134-49c0-4cd3-b384-808206a845f5 response_code = 500 uri = /timesync
8322025-03-04T03:15:25.551ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8332025-03-04T03:15:25.738ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8342025-03-04T03:15:25.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62475
8352025-03-04T03:15:25.747ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4013
8362025-03-04T03:15:25.747ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8527 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62475 req_id = 99efdff2-e43d-40df-9dde-2169860855e2 response_code = 500 uri = /timesync
8372025-03-04T03:15:25.748ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8382025-03-04T03:15:25.886ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8392025-03-04T03:15:25.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33056
8402025-03-04T03:15:27.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8412025-03-04T03:15:27.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8422025-03-04T03:15:29.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8432025-03-04T03:15:29.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8442025-03-04T03:15:30.133ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_92dd4a5d-701b-4209-bc9d-49a6c4a9cc89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4013
8452025-03-04T03:15:30.134ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33056 req_id = 223cfe1c-15cb-498e-a77b-d0678fe8f42d response_code = 500 uri = /timesync
8462025-03-04T03:15:30.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8472025-03-04T03:15:30.409ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8482025-03-04T03:15:30.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42696
8492025-03-04T03:15:30.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8700 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42696 req_id = cd2c2217-be07-4645-af6f-fc9cf97d96d4 response_code = 200 uri = /timesync
8502025-03-04T03:15:30.420ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.228496805 } file = sled-agent/src/rack_setup/service.rs:744
8512025-03-04T03:15:30.420ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8522025-03-04T03:15:30.688ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8532025-03-04T03:15:30.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54379
8542025-03-04T03:15:30.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9410 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54379 req_id = 970476cb-e842-46c4-9f19-60745a172f33 response_code = 200 uri = /timesync
8552025-03-04T03:15:30.700ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058130.5395312, correction: 0.229134589 } file = sled-agent/src/rack_setup/service.rs:744
8562025-03-04T03:15:30.700ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8572025-03-04T03:15:30.993ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8582025-03-04T03:15:30.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35489
8592025-03-04T03:15:31.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35489 req_id = 969babc2-bd67-42fb-a0c9-24b679a17b82 response_code = 200 uri = /timesync
8602025-03-04T03:15:31.004ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.228315681 } file = sled-agent/src/rack_setup/service.rs:744
8612025-03-04T03:15:31.004ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8622025-03-04T03:15:31.337ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8632025-03-04T03:15:31.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38714
8642025-03-04T03:15:31.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38714 req_id = 37e50670-2543-40cc-b53f-1a09d58d8e0d response_code = 200 uri = /timesync
8652025-03-04T03:15:31.349ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.227386117 } file = sled-agent/src/rack_setup/service.rs:744
8662025-03-04T03:15:31.349ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8672025-03-04T03:15:31.578ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8682025-03-04T03:15:31.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47845
8692025-03-04T03:15:31.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47845 req_id = 245a9e34-8de3-4589-9bc4-81cd5f2d3a5c response_code = 200 uri = /timesync
8702025-03-04T03:15:31.590ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.226734251 } file = sled-agent/src/rack_setup/service.rs:744
8712025-03-04T03:15:31.590ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8722025-03-04T03:15:31.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8732025-03-04T03:15:31.603ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8742025-03-04T03:15:31.862ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 232.836774ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8752025-03-04T03:15:32.036ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8762025-03-04T03:15:32.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38523
8772025-03-04T03:15:32.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38523 req_id = cd29b06f-f0ce-4149-bf6c-b7588fe9a004 response_code = 200 uri = /timesync
8782025-03-04T03:15:32.048ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.225655854 } file = sled-agent/src/rack_setup/service.rs:744
8792025-03-04T03:15:32.048ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8802025-03-04T03:15:32.708ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8812025-03-04T03:15:32.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8822025-03-04T03:15:32.852ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8832025-03-04T03:15:32.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42582
8842025-03-04T03:15:32.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42582 req_id = 3f6a9ab9-f7cd-463c-ac1e-67460ba0ee90 response_code = 200 uri = /timesync
8852025-03-04T03:15:32.863ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.223371014 } file = sled-agent/src/rack_setup/service.rs:744
8862025-03-04T03:15:32.863ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8872025-03-04T03:15:33.301ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
8882025-03-04T03:15:33.566ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8892025-03-04T03:15:33.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34893
8902025-03-04T03:15:33.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34893 req_id = c79072c3-90fb-4525-b756-b91ad32839f7 response_code = 200 uri = /timesync
8912025-03-04T03:15:33.576ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741058129.4873374, correction: 0.221444622 } file = sled-agent/src/rack_setup/service.rs:744
8922025-03-04T03:15:33.576ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8932025-03-04T03:15:34.428ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8942025-03-04T03:15:34.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56565
8952025-03-04T03:15:34.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9076 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56565 req_id = 7228c113-11a6-4daa-818a-4d376c15bbde response_code = 200 uri = /timesync
8962025-03-04T03:15:34.439ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058133.250008, correction: 0.219200537 } file = sled-agent/src/rack_setup/service.rs:744
8972025-03-04T03:15:34.439ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8982025-03-04T03:15:35.190ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8992025-03-04T03:15:35.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60667
9002025-03-04T03:15:35.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8092 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60667 req_id = edc2a599-f16d-41c0-81a1-a727bf9bcbfc response_code = 200 uri = /timesync
9012025-03-04T03:15:35.201ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058134.3503437, correction: 0.217016473 } file = sled-agent/src/rack_setup/service.rs:744
9022025-03-04T03:15:35.201ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9032025-03-04T03:15:36.366ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9042025-03-04T03:15:36.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33243
9052025-03-04T03:15:36.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33243 req_id = 7e750701-c116-4067-adc4-e2898e443edc response_code = 200 uri = /timesync
9062025-03-04T03:15:36.378ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058135.1819165, correction: 0.213714138 } file = sled-agent/src/rack_setup/service.rs:744
9072025-03-04T03:15:36.378ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9082025-03-04T03:15:37.557ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9092025-03-04T03:15:37.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40629
9102025-03-04T03:15:37.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40629 req_id = 59580d1b-2d82-4789-8716-e975e677f97b response_code = 200 uri = /timesync
9112025-03-04T03:15:37.569ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058136.0178237, correction: 0.210354701 } file = sled-agent/src/rack_setup/service.rs:744
9122025-03-04T03:15:37.569ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9132025-03-04T03:15:37.990ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9142025-03-04T03:15:37.990ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9152025-03-04T03:15:38.266ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53227
9162025-03-04T03:15:38.266ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53227 req_id = 018803f7-cb24-4999-a0f5-ca1387575dfb response_code = 200 uri = /baseboard
9172025-03-04T03:15:38.409ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9182025-03-04T03:15:38.409ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9192025-03-04T03:15:38.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9202025-03-04T03:15:38.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45379
9212025-03-04T03:15:38.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45379 req_id = 074a0df0-acac-4959-803f-78b28af00bf1 response_code = 200 uri = /timesync
9222025-03-04T03:15:38.871ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058138.7698188, correction: 0.20634678 } file = sled-agent/src/rack_setup/service.rs:744
9232025-03-04T03:15:38.871ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9242025-03-04T03:15:41.536ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9252025-03-04T03:15:41.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54417
9262025-03-04T03:15:41.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54417 req_id = 0cd366c6-653b-4572-9234-6b684bcd09fe response_code = 200 uri = /timesync
9272025-03-04T03:15:41.547ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058140.111655, correction: 0.19903928 } file = sled-agent/src/rack_setup/service.rs:744
9282025-03-04T03:15:41.547ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9292025-03-04T03:15:41.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9302025-03-04T03:15:41.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9312025-03-04T03:15:42.738ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9322025-03-04T03:15:42.796ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9332025-03-04T03:15:43.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9342025-03-04T03:15:44.516ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9352025-03-04T03:15:44.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32805
9362025-03-04T03:15:44.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32805 req_id = 32b5bda2-6759-4906-be34-40935fab8373 response_code = 200 uri = /timesync
9372025-03-04T03:15:44.529ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058143.0908227, correction: 0.190931648 } file = sled-agent/src/rack_setup/service.rs:744
9382025-03-04T03:15:44.529ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9392025-03-04T03:15:46.470ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9402025-03-04T03:15:46.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37989
9412025-03-04T03:15:46.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8035 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37989 req_id = 776e0c0b-e129-43c9-8cd3-e81969829a8d response_code = 200 uri = /timesync
9422025-03-04T03:15:46.480ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058145.766028, correction: 0.185747102 } file = sled-agent/src/rack_setup/service.rs:744
9432025-03-04T03:15:46.480ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9442025-03-04T03:15:47.173ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 725.174415ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9452025-03-04T03:15:48.020ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9462025-03-04T03:15:48.020ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9472025-03-04T03:15:48.439ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9482025-03-04T03:15:48.439ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9492025-03-04T03:15:51.113ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9502025-03-04T03:15:51.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62366
9512025-03-04T03:15:51.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62366 req_id = 60911334-a139-4e6e-b597-e3deb045edd8 response_code = 200 uri = /timesync
9522025-03-04T03:15:51.126ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058150.46531, correction: 0.173288405 } file = sled-agent/src/rack_setup/service.rs:744
9532025-03-04T03:15:51.126ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9542025-03-04T03:15:51.663ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9552025-03-04T03:15:51.663ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9562025-03-04T03:15:52.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9572025-03-04T03:15:52.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9582025-03-04T03:15:53.358ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9592025-03-04T03:15:54.829ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9602025-03-04T03:15:54.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56044
9612025-03-04T03:15:54.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56044 req_id = 6a4a6a31-51b3-4e4f-a974-206852fdd83d response_code = 200 uri = /timesync
9622025-03-04T03:15:54.842ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058153.2648768, correction: 0.163236201 } file = sled-agent/src/rack_setup/service.rs:744
9632025-03-04T03:15:54.842ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9642025-03-04T03:15:58.049ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10376099711811078828 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9652025-03-04T03:15:58.050ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12524804551670208176 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9662025-03-04T03:15:58.468ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9672025-03-04T03:15:58.468ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9682025-03-04T03:16:01.693ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9692025-03-04T03:16:01.693ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9702025-03-04T03:16:01.729ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9712025-03-04T03:16:01.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46704
9722025-03-04T03:16:01.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46704 req_id = b4a4f969-8d32-46aa-ab9b-c961dfc4f2b3 response_code = 200 uri = /timesync
9732025-03-04T03:16:01.743ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058159.8915634, correction: 0.144741938 } file = sled-agent/src/rack_setup/service.rs:744
9742025-03-04T03:16:01.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9752025-03-04T03:16:02.797ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9762025-03-04T03:16:02.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9772025-03-04T03:16:02.976ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 632.472946ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9782025-03-04T03:16:03.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9792025-03-04T03:16:05.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9802025-03-04T03:16:05.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39764
9812025-03-04T03:16:05.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39764 req_id = 6cc5836a-5779-4d90-b956-2a7155290455 response_code = 200 uri = /timesync
9822025-03-04T03:16:05.609ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058164.0936506, correction: 0.134063959 } file = sled-agent/src/rack_setup/service.rs:744
9832025-03-04T03:16:05.609ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9842025-03-04T03:16:08.381ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47723
9852025-03-04T03:16:08.381ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47723 req_id = be560f1c-d946-407b-a185-4104d1a3add6 response_code = 200 uri = /baseboard
9862025-03-04T03:16:08.497ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9872025-03-04T03:16:08.497ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9882025-03-04T03:16:10.808ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9892025-03-04T03:16:10.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41932
9902025-03-04T03:16:10.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41932 req_id = 381b468c-11d0-44fe-9f60-16022f635ccd response_code = 200 uri = /timesync
9912025-03-04T03:16:10.820ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058169.9096315, correction: 0.119980991 } file = sled-agent/src/rack_setup/service.rs:744
9922025-03-04T03:16:10.820ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
9932025-03-04T03:16:11.722ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9942025-03-04T03:16:11.722ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9952025-03-04T03:16:12.826ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2742176996589229910 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9962025-03-04T03:16:12.882ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2229439829545372365 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9972025-03-04T03:16:13.415ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1188331345610196075 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
9982025-03-04T03:16:16.283ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
9992025-03-04T03:16:16.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56762
10002025-03-04T03:16:16.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56762 req_id = 76c9cdef-d6f4-488f-b84e-4535c5d077a7 response_code = 200 uri = /timesync
10012025-03-04T03:16:16.296ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058175.758118, correction: 0.105201989 } file = sled-agent/src/rack_setup/service.rs:744
10022025-03-04T03:16:16.296ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
10032025-03-04T03:16:18.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10042025-03-04T03:16:18.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10052025-03-04T03:16:18.686ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.986799017s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10062025-03-04T03:16:21.191ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
10072025-03-04T03:16:21.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50032
10082025-03-04T03:16:21.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50032 req_id = 4a7848c2-624f-4f85-a8f2-6e9fc6a2347c response_code = 200 uri = /timesync
10092025-03-04T03:16:21.203ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058180.071995, correction: 0.09195222 } file = sled-agent/src/rack_setup/service.rs:744
10102025-03-04T03:16:21.203ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
10112025-03-04T03:16:21.752ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6153817564064313318 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10122025-03-04T03:16:21.752ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11937763798624861667 reason = Duration(60s) sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10132025-03-04T03:16:28.556ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10142025-03-04T03:16:28.556ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10152025-03-04T03:16:32.533ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
10162025-03-04T03:16:32.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52898
10172025-03-04T03:16:32.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52898 req_id = 343be931-d920-4032-ba8e-770eed31131c response_code = 200 uri = /timesync
10182025-03-04T03:16:32.544ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058191.194665, correction: 0.061309829 } file = sled-agent/src/rack_setup/service.rs:744
10192025-03-04T03:16:32.544ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
10202025-03-04T03:16:36.759ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.170191434s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10212025-03-04T03:16:38.496ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38411
10222025-03-04T03:16:38.496ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38411 req_id = ba31aacc-61dc-476a-9480-c9f713fabf60 response_code = 200 uri = /baseboard
10232025-03-04T03:16:38.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15858120721675323713 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10242025-03-04T03:16:38.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4780869490503386422 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10252025-03-04T03:16:41.911ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
10262025-03-04T03:16:41.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49054
10272025-03-04T03:16:41.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 20667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49054 req_id = fe433a35-53e1-4803-93c4-d6879f8050dc response_code = 200 uri = /timesync
10282025-03-04T03:16:41.932ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:15:58.049720633Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10376099711811078828 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10292025-03-04T03:16:41.933ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:16:12.826511926Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2742176996589229910 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10302025-03-04T03:16:41.934ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:16:21.752800890Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11937763798624861667 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10312025-03-04T03:16:41.934ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:15:58.050225023Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12524804551670208176 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10322025-03-04T03:16:41.935ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:16:13.415880569Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1188331345610196075 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10332025-03-04T03:16:41.935ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:16:21.752497015Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6153817564064313318 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10342025-03-04T03:16:41.935ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-04T03:16:12.882341677Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2229439829545372365 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
10352025-03-04T03:16:41.937ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1741058197.4496417, correction: 0.035973363 } file = sled-agent/src/rack_setup/service.rs:744
10362025-03-04T03:16:41.937ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1379
10372025-03-04T03:16:41.968ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 99798c93-1ef2-44fb-9fde-7dd780a62a5e (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 13b4e778-1c69-4f32-9182-d8fdea8251cd (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: a5620ef8-a00b-4ddd-8732-aebedbdd8941 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 (service), filesystem_pool: Some(ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0c4f229a-6961-4c6d-935f-c5ffbe7f7b53, kind: Service { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 }, name: Name("ntp-92dd4a5d-701b-4209-bc9d-49a6c4a9cc89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: fb0bd24e-f049-4a79-89b8-145198cf610d (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a80a1624-85cc-455a-a0fa-0939975aebd7 (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 471349e5-7d05-4599-8335-0e1685492a11 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1738b318-45f4-46a8-b5d4-04ddd1db4331 (service), filesystem_pool: Some(ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24 (service), filesystem_pool: Some(ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
10382025-03-04T03:16:41.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39297
10392025-03-04T03:16:41.968ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-03-04T03:16:41.968ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412025-03-04T03:16:41.979ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-03-04T03:16:41.979ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }
10432025-03-04T03:16:41.988ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-03-04T03:16:41.988ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10452025-03-04T03:16:41.997ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-03-04T03:16:41.997ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472025-03-04T03:16:42.008ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-03-04T03:16:42.008ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-03-04T03:16:42.018ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-03-04T03:16:42.018ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512025-03-04T03:16:42.029ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-03-04T03:16:42.029ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10532025-03-04T03:16:42.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-03-04T03:16:42.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10552025-03-04T03:16:42.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10562025-03-04T03:16:42.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
10572025-03-04T03:16:42.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
10582025-03-04T03:16:42.049ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4975 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10592025-03-04T03:16:42.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10602025-03-04T03:16:42.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10612025-03-04T03:16:42.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10622025-03-04T03:16:42.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10632025-03-04T03:16:42.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10642025-03-04T03:16:42.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10652025-03-04T03:16:42.222ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11 file = illumos-utils/src/zone.rs:327
10662025-03-04T03:16:42.225ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331 file = illumos-utils/src/zone.rs:327
10672025-03-04T03:16:42.230ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24 file = illumos-utils/src/zone.rs:327
10682025-03-04T03:16:42.234ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7 file = illumos-utils/src/zone.rs:327
10692025-03-04T03:16:42.240ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d file = illumos-utils/src/zone.rs:327
10702025-03-04T03:16:42.244ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11 file = illumos-utils/src/zone.rs:365
10712025-03-04T03:16:42.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331 file = illumos-utils/src/zone.rs:365
10722025-03-04T03:16:42.253ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24 file = illumos-utils/src/zone.rs:365
10732025-03-04T03:16:42.257ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7 file = illumos-utils/src/zone.rs:365
10742025-03-04T03:16:42.261ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d file = illumos-utils/src/zone.rs:365
10752025-03-04T03:16:46.697ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fb0bd24e-f049-4a79-89b8-145198cf610d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762025-03-04T03:16:46.697ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
10772025-03-04T03:16:46.867ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='471349e5-7d05-4599-8335-0e1685492a11'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782025-03-04T03:16:46.868ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
10792025-03-04T03:16:46.882ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802025-03-04T03:16:46.882ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
10812025-03-04T03:16:46.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 66.500763ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
10822025-03-04T03:16:46.906ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a80a1624-85cc-455a-a0fa-0939975aebd7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832025-03-04T03:16:46.906ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
10842025-03-04T03:16:46.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 102.854634ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
10852025-03-04T03:16:47.021ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1738b318-45f4-46a8-b5d4-04ddd1db4331'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10862025-03-04T03:16:47.021ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
10872025-03-04T03:16:47.067ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 48.874214ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
10882025-03-04T03:16:47.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 44.803921ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
10892025-03-04T03:16:47.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 38.447456ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
10902025-03-04T03:16:47.104ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 201.72977ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
10912025-03-04T03:16:47.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 140.079907ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
10922025-03-04T03:16:47.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 73.300307ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
10932025-03-04T03:16:47.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 71.01066ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
10942025-03-04T03:16:47.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 167.535551ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
10952025-03-04T03:16:47.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 195.407299ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
10962025-03-04T03:16:47.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 169.527691ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
10972025-03-04T03:16:47.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 42.809826ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
10982025-03-04T03:16:47.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 471.224739ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
10992025-03-04T03:16:47.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 114.923402ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11002025-03-04T03:16:47.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 395.660673ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11012025-03-04T03:16:47.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 418.92338ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11022025-03-04T03:16:47.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 112.779862ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11032025-03-04T03:16:47.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 378.415112ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11042025-03-04T03:16:47.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 599.553999ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11052025-03-04T03:16:47.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 664.643219ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11062025-03-04T03:16:47.836ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 977.138581ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11072025-03-04T03:16:47.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 926.799151ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11082025-03-04T03:16:47.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 488.184461ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11092025-03-04T03:16:48.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 715.690924ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11102025-03-04T03:16:48.411ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 1.00991639s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11112025-03-04T03:16:48.488ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 588.492437ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11122025-03-04T03:16:48.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 1.442685962s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11132025-03-04T03:16:48.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 912.706293ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11142025-03-04T03:16:48.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 1.448317378s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11152025-03-04T03:16:49.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 921.526351ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11162025-03-04T03:16:49.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 588.346349ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11172025-03-04T03:16:49.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.379205473s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11182025-03-04T03:16:50.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 646.637929ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11192025-03-04T03:16:50.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 852.743299ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11202025-03-04T03:16:50.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 1.118581164s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11212025-03-04T03:16:50.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 1.359864838s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11222025-03-04T03:16:50.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 687.88631ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11232025-03-04T03:16:50.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 1.008747341s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11242025-03-04T03:16:51.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 754.866748ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11252025-03-04T03:16:51.381ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 781.216558ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11262025-03-04T03:16:51.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 979.680894ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11272025-03-04T03:16:51.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 833.03033ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11282025-03-04T03:16:51.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 1.137647393s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11292025-03-04T03:16:51.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 576.533378ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11302025-03-04T03:16:52.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d") failed: Property not found. retry in 1.313290168s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11312025-03-04T03:16:52.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24") failed: Property not found. retry in 1.061476433s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11322025-03-04T03:16:52.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 872.36045ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11332025-03-04T03:16:52.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 529.755997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11342025-03-04T03:16:53.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11") failed: Property not found. retry in 1.223202586s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11352025-03-04T03:16:53.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331") failed: Property not found. retry in 844.317054ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11362025-03-04T03:16:53.411ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.348820063s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11372025-03-04T03:16:54.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.122728934s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11382025-03-04T03:16:56.525ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.596746351s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
11392025-03-04T03:16:56.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.176128339s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11402025-03-04T03:16:57.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 944.9004ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11412025-03-04T03:16:58.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 566.975675ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11422025-03-04T03:16:59.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.093397679s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11432025-03-04T03:17:00.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.476140588s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11442025-03-04T03:17:01.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 714.539673ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11452025-03-04T03:17:02.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 590.069428ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11462025-03-04T03:17:03.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 958.510949ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11472025-03-04T03:17:04.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 657.665496ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11482025-03-04T03:17:04.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7") failed: Property not found. retry in 1.068676907s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11492025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_471349e5-7d05-4599-8335-0e1685492a11
11502025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_1738b318-45f4-46a8-b5d4-04ddd1db4331
11512025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24
11522025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_a80a1624-85cc-455a-a0fa-0939975aebd7
11532025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_fb0bd24e-f049-4a79-89b8-145198cf610d
11542025-03-04T03:17:05.948ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
11552025-03-04T03:17:05.950ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
11562025-03-04T03:17:05.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 23947456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39297 req_id = ad7f6bca-c591-412a-9700-eca3cda57a9f response_code = 204 uri = /omicron-zones
11572025-03-04T03:17:05.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60469
11582025-03-04T03:17:06.020ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3856
11592025-03-04T03:17:07.163ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3874
11602025-03-04T03:17:21.290ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3897
11612025-03-04T03:17:21.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 15302778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60469 req_id = 1163691a-1a27-4ab7-a8f3-ccaa9adbd716 response_code = 204 uri = /cockroachdb
11622025-03-04T03:17:21.290ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57019
11632025-03-04T03:17:21.291ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57019 req_id = 45593599-7605-4cc3-9942-1e266d1bef2b response_code = 200 uri = /baseboard
11642025-03-04T03:17:21.295ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 13.12545836s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
11652025-03-04T03:17:21.326ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 99798c93-1ef2-44fb-9fde-7dd780a62a5e (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 13b4e778-1c69-4f32-9182-d8fdea8251cd (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: a5620ef8-a00b-4ddd-8732-aebedbdd8941 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 (service), filesystem_pool: Some(ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0c4f229a-6961-4c6d-935f-c5ffbe7f7b53, kind: Service { id: 92dd4a5d-701b-4209-bc9d-49a6c4a9cc89 }, name: Name("ntp-92dd4a5d-701b-4209-bc9d-49a6c4a9cc89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: fb0bd24e-f049-4a79-89b8-145198cf610d (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a80a1624-85cc-455a-a0fa-0939975aebd7 (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 471349e5-7d05-4599-8335-0e1685492a11 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1738b318-45f4-46a8-b5d4-04ddd1db4331 (service), filesystem_pool: Some(ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ed5a6cc4-57e5-44c8-b3a7-ed686ad58c24 (service), filesystem_pool: Some(ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 72700cb3-c938-46f0-9b9c-46cf389d975e (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: d8484452-7d43-42ac-a588-575b6d31b882 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 (service), filesystem_pool: Some(ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 (service), filesystem_pool: Some(ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 5eaa31d5-c53c-4a12-9056-f7a4d016f45c (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ff5593fa-b539-4a70-bfa5-8ea58fcd766d (service), filesystem_pool: Some(ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 24d39e5f-f5d7-40f5-b48a-2fc33313f762 (service), filesystem_pool: Some(ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 05cdc36e-5e5c-48ec-8400-66f9d706ea80 (service), filesystem_pool: Some(ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: c870825c-4dd8-4d30-bee2-21e2e79525a6 (service), filesystem_pool: Some(ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7b769dfa-f11a-47f4-9620-313afcc6dd95 (service), filesystem_pool: Some(ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 99c546d1-d487-413a-bbeb-feee972c9a30 (service), filesystem_pool: Some(ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: d9eb5323-cf50-4e0a-a06d-d1f5284086b8 (service), filesystem_pool: Some(ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: bcef9acd-8e55-4275-aeea-1bfdc7ee15a5 (service), filesystem_pool: Some(ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8191d28f-a54d-4432-b5b1-39f2a89113a1 (service), filesystem_pool: Some(ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8 (service), filesystem_pool: Some(ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ad8b3774-89b6-46eb-84b1-cdb031c615c3 (service), filesystem_pool: Some(ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 382dd280-976a-45c5-b45f-5de9952f556b (service), filesystem_pool: Some(ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
11662025-03-04T03:17:21.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34808
11672025-03-04T03:17:21.327ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11682025-03-04T03:17:21.327ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11692025-03-04T03:17:21.339ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11702025-03-04T03:17:21.339ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: InternalDns }, responder: ... }
11712025-03-04T03:17:21.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11722025-03-04T03:17:21.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11732025-03-04T03:17:21.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11742025-03-04T03:17:21.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11752025-03-04T03:17:21.369ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11762025-03-04T03:17:21.369ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Cockroach }, responder: ... }
11772025-03-04T03:17:21.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11782025-03-04T03:17:21.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11792025-03-04T03:17:21.386ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11802025-03-04T03:17:21.386ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11812025-03-04T03:17:21.394ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11822025-03-04T03:17:21.394ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11832025-03-04T03:17:21.404ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11842025-03-04T03:17:21.404ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11852025-03-04T03:17:21.413ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11862025-03-04T03:17:21.413ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11872025-03-04T03:17:21.427ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11882025-03-04T03:17:21.427ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11892025-03-04T03:17:21.437ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11902025-03-04T03:17:21.437ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, kind: Crucible }, responder: ... }
11912025-03-04T03:17:21.447ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11922025-03-04T03:17:21.447ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, kind: Crucible }, responder: ... }
11932025-03-04T03:17:21.457ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11942025-03-04T03:17:21.457ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, kind: Crucible }, responder: ... }
11952025-03-04T03:17:21.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11962025-03-04T03:17:21.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, kind: Crucible }, responder: ... }
11972025-03-04T03:17:21.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11982025-03-04T03:17:21.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, kind: Crucible }, responder: ... }
11992025-03-04T03:17:21.486ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12002025-03-04T03:17:21.486ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, kind: Crucible }, responder: ... }
12012025-03-04T03:17:21.498ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12022025-03-04T03:17:21.498ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, kind: Crucible }, responder: ... }
12032025-03-04T03:17:21.508ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12042025-03-04T03:17:21.508ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, kind: Crucible }, responder: ... }
12052025-03-04T03:17:21.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12062025-03-04T03:17:21.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12072025-03-04T03:17:21.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12082025-03-04T03:17:21.530ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
12092025-03-04T03:17:21.530ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
12102025-03-04T03:17:21.530ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4975 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
12112025-03-04T03:17:21.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12122025-03-04T03:17:21.661ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12132025-03-04T03:17:21.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12142025-03-04T03:17:21.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152025-03-04T03:17:21.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12162025-03-04T03:17:21.663ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12172025-03-04T03:17:21.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182025-03-04T03:17:21.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12192025-03-04T03:17:21.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12202025-03-04T03:17:21.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-03-04T03:17:21.713ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-03-04T03:17:21.871ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12232025-03-04T03:17:21.937ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12242025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12262025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12272025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12282025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12292025-03-04T03:17:21.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12302025-03-04T03:17:21.939ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12312025-03-04T03:17:21.939ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6 file = illumos-utils/src/zone.rs:327
12322025-03-04T03:17:21.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d file = illumos-utils/src/zone.rs:327
12332025-03-04T03:17:21.950ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5 file = illumos-utils/src/zone.rs:327
12342025-03-04T03:17:21.955ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3 file = illumos-utils/src/zone.rs:327
12352025-03-04T03:17:21.961ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c file = illumos-utils/src/zone.rs:327
12362025-03-04T03:17:21.967ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8 file = illumos-utils/src/zone.rs:327
12372025-03-04T03:17:21.971ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30 file = illumos-utils/src/zone.rs:327
12382025-03-04T03:17:21.976ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80 file = illumos-utils/src/zone.rs:327
12392025-03-04T03:17:22.099ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6 file = illumos-utils/src/zone.rs:365
12402025-03-04T03:17:22.105ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d file = illumos-utils/src/zone.rs:365
12412025-03-04T03:17:22.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5 file = illumos-utils/src/zone.rs:365
12422025-03-04T03:17:22.113ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3 file = illumos-utils/src/zone.rs:365
12432025-03-04T03:17:22.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c file = illumos-utils/src/zone.rs:365
12442025-03-04T03:17:22.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8 file = illumos-utils/src/zone.rs:365
12452025-03-04T03:17:22.127ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30 file = illumos-utils/src/zone.rs:365
12462025-03-04T03:17:22.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80 file = illumos-utils/src/zone.rs:365
12472025-03-04T03:17:22.139ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762 file = illumos-utils/src/zone.rs:327
12482025-03-04T03:17:22.144ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1 file = illumos-utils/src/zone.rs:327
12492025-03-04T03:17:22.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95 file = illumos-utils/src/zone.rs:327
12502025-03-04T03:17:22.156ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8 file = illumos-utils/src/zone.rs:327
12512025-03-04T03:17:22.162ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a file = illumos-utils/src/zone.rs:327
12522025-03-04T03:17:22.168ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b file = illumos-utils/src/zone.rs:327
12532025-03-04T03:17:22.235ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12542025-03-04T03:17:22.236ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762 file = illumos-utils/src/zone.rs:365
12552025-03-04T03:17:22.249ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1 file = illumos-utils/src/zone.rs:365
12562025-03-04T03:17:22.263ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95 file = illumos-utils/src/zone.rs:365
12572025-03-04T03:17:22.286ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8 file = illumos-utils/src/zone.rs:365
12582025-03-04T03:17:22.310ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a file = illumos-utils/src/zone.rs:365
12592025-03-04T03:17:22.324ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b file = illumos-utils/src/zone.rs:365
12602025-03-04T03:17:22.408ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12612025-03-04T03:17:22.473ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12622025-03-04T03:17:22.533ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12632025-03-04T03:17:22.602ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12642025-03-04T03:17:22.605ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12652025-03-04T03:17:22.605ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12662025-03-04T03:17:22.662ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 134, 246]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12672025-03-04T03:17:22.662ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = external_dns
12682025-03-04T03:17:22.666ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12692025-03-04T03:17:22.666ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12702025-03-04T03:17:22.722ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 205, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12712025-03-04T03:17:22.722ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = nexus
12722025-03-04T03:17:22.724ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12732025-03-04T03:17:22.724ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12742025-03-04T03:17:22.777ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 229, 93]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12752025-03-04T03:17:22.777ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = nexus
12762025-03-04T03:17:22.781ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12772025-03-04T03:17:22.781ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12782025-03-04T03:17:22.837ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 213, 8]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12792025-03-04T03:17:22.837ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = external_dns
12802025-03-04T03:17:22.839ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12812025-03-04T03:17:22.839ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12822025-03-04T03:17:22.899ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 148, 61]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12832025-03-04T03:17:22.899ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1360 zone_type = nexus
12842025-03-04T03:17:22.899ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12852025-03-04T03:17:22.899ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12862025-03-04T03:17:22.914ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12872025-03-04T03:17:22.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12882025-03-04T03:17:22.965ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12892025-03-04T03:17:22.965ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12902025-03-04T03:17:22.965ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12912025-03-04T03:17:22.965ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12922025-03-04T03:17:22.966ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12932025-03-04T03:17:22.966ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12942025-03-04T03:17:22.966ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12952025-03-04T03:17:22.966ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12962025-03-04T03:17:22.966ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12972025-03-04T03:17:22.972ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12982025-03-04T03:17:22.975ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12992025-03-04T03:17:22.975ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13002025-03-04T03:17:22.975ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13012025-03-04T03:17:22.978ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13022025-03-04T03:17:22.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13032025-03-04T03:17:22.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13042025-03-04T03:17:23.107ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e file = illumos-utils/src/zone.rs:327
13052025-03-04T03:17:23.114ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5 file = illumos-utils/src/zone.rs:327
13062025-03-04T03:17:23.120ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882 file = illumos-utils/src/zone.rs:327
13072025-03-04T03:17:23.126ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 file = illumos-utils/src/zone.rs:327
13082025-03-04T03:17:23.132ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2 file = illumos-utils/src/zone.rs:327
13092025-03-04T03:17:23.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e file = illumos-utils/src/zone.rs:365
13102025-03-04T03:17:23.142ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5 file = illumos-utils/src/zone.rs:365
13112025-03-04T03:17:23.150ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882 file = illumos-utils/src/zone.rs:365
13122025-03-04T03:17:23.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2 file = illumos-utils/src/zone.rs:365
13132025-03-04T03:17:23.163ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 file = illumos-utils/src/zone.rs:365
13142025-03-04T03:17:25.748ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13152025-03-04T03:17:25.748ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13162025-03-04T03:17:25.755ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13172025-03-04T03:17:25.756ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13182025-03-04T03:17:25.802ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_92e4d589-1042-4d5f-a963-b670e19540f9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2a0af106-0f85-4288-abf2-3102355deb0e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192025-03-04T03:17:25.802ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13202025-03-04T03:17:25.810ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ce1d8eb5-4250-40ee-a991-35c54c086636/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='772e0ea0-467c-4f0b-aa07-ac2856a78750'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212025-03-04T03:17:25.811ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8bf53b00-dedd-4516-be68-25e52e3985f5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3389a486-2d3a-49ce-9d98-a2e50d317098'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222025-03-04T03:17:25.811ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0f5a6c58-1c30-47ae-a153-103b4aa414cb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232025-03-04T03:17:25.811ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13242025-03-04T03:17:25.819ZINFOSledAgent (ServiceManager): Booting oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13252025-03-04T03:17:25.825ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13262025-03-04T03:17:25.831ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1964c788-7757-47d7-a047-afbba252b861'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272025-03-04T03:17:25.832ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5bfe08ce-4eca-48ac-8b48-ae534f68fb4d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13282025-03-04T03:17:25.832ZINFOSledAgent (ServiceManager): Booting oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13292025-03-04T03:17:25.838ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13302025-03-04T03:17:25.845ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='50b2b350-bd0e-4cf6-9318-8b0c0d523ffb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312025-03-04T03:17:25.845ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13322025-03-04T03:17:26.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 39.306123ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13332025-03-04T03:17:26.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 66.188373ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13342025-03-04T03:17:26.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 44.61427ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13352025-03-04T03:17:26.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 57.15339ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13362025-03-04T03:17:26.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 44.157199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13372025-03-04T03:17:26.326ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 62.378713ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13382025-03-04T03:17:26.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 58.438847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13392025-03-04T03:17:26.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 48.77665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13402025-03-04T03:17:26.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 96.114371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13412025-03-04T03:17:26.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 44.361262ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13422025-03-04T03:17:26.397ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 133.074149ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13432025-03-04T03:17:26.415ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 54.849591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13442025-03-04T03:17:26.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 140.370116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13452025-03-04T03:17:30.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 51.401774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13462025-03-04T03:17:30.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 52.09031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13472025-03-04T03:17:31.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 112.176122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13482025-03-04T03:17:31.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 102.076777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13492025-03-04T03:17:32.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 99.927234ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13502025-03-04T03:17:32.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 279.421524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13512025-03-04T03:17:32.411ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13522025-03-04T03:17:32.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 282.282341ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13532025-03-04T03:17:32.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 165.954498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13542025-03-04T03:17:32.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 196.736638ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13552025-03-04T03:17:32.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 267.39022ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13562025-03-04T03:17:32.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 130.981752ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13572025-03-04T03:17:32.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 241.676229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13582025-03-04T03:17:32.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 162.966421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13592025-03-04T03:17:32.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 233.768704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13602025-03-04T03:17:32.594ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13612025-03-04T03:17:32.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 210.329654ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13622025-03-04T03:17:32.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 516.525862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13632025-03-04T03:17:32.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 523.886998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13642025-03-04T03:17:32.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 307.783047ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13652025-03-04T03:17:32.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 579.190435ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13662025-03-04T03:17:32.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 569.964222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13672025-03-04T03:17:32.802ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 448.82418ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13682025-03-04T03:17:32.817ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 442.696856ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13692025-03-04T03:17:32.840ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 575.700719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13702025-03-04T03:17:32.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 1.067835496s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
13712025-03-04T03:17:32.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 26.382842ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13722025-03-04T03:17:33.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 111.143823ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13732025-03-04T03:17:33.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 673.269682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13742025-03-04T03:17:33.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 238.991107ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13752025-03-04T03:17:33.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 1.033521989s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
13762025-03-04T03:17:33.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 1.138948736s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
13772025-03-04T03:17:33.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 628.444051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
13782025-03-04T03:17:33.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 705.908452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
13792025-03-04T03:17:33.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 927.305321ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
13802025-03-04T03:17:33.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 813.284297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
13812025-03-04T03:17:33.389ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 273.758829ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13822025-03-04T03:17:33.390ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8a0f1632-b5ad-43a8-84a8-e7a6a55135ee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13832025-03-04T03:17:33.391ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
13842025-03-04T03:17:33.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 778.610903ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
13852025-03-04T03:17:33.627ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862025-03-04T03:17:33.627ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
13872025-03-04T03:17:33.639ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13882025-03-04T03:17:33.639ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
13892025-03-04T03:17:33.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 35.533938ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
13902025-03-04T03:17:33.659ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13912025-03-04T03:17:33.659ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
13922025-03-04T03:17:33.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 603.808161ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
13932025-03-04T03:17:33.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 52.734124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
13942025-03-04T03:17:33.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.381660712s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
13952025-03-04T03:17:33.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 148.919002ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
13962025-03-04T03:17:33.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 72.81844ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
13972025-03-04T03:17:33.924ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 44.183521ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
13982025-03-04T03:17:33.935ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 443.480137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
13992025-03-04T03:17:33.947ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 47.496658ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14002025-03-04T03:17:33.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 555.358059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
14012025-03-04T03:17:33.975ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 817.391282ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
14022025-03-04T03:17:33.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 121.441518ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14032025-03-04T03:17:34.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 118.038908ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14042025-03-04T03:17:34.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 116.133385ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14052025-03-04T03:17:34.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 1.263748925s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
14062025-03-04T03:17:34.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 121.217027ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14072025-03-04T03:17:34.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 117.503343ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14082025-03-04T03:17:34.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 245.326837ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14092025-03-04T03:17:34.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 913.70771ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
14102025-03-04T03:17:34.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 1.462192885s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
14112025-03-04T03:17:34.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 241.862605ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14122025-03-04T03:17:34.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 285.817081ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14132025-03-04T03:17:34.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 957.40344ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
14142025-03-04T03:17:34.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 584.580443ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
14152025-03-04T03:17:34.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 200.906494ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14162025-03-04T03:17:34.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 1.332386577s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
14172025-03-04T03:17:34.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.355733094s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
14182025-03-04T03:17:34.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 637.147855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
14192025-03-04T03:17:34.783ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 850.979726ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14202025-03-04T03:17:34.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.409027164s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
14212025-03-04T03:17:34.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 564.891324ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14222025-03-04T03:17:34.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 924.941137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
14232025-03-04T03:17:34.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 685.483233ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14242025-03-04T03:17:35.085ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3b742476-8c95-46a6-bdd6-c944bd9fd83e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14252025-03-04T03:17:35.085ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14262025-03-04T03:17:35.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 613.324941ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
14272025-03-04T03:17:35.114ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14282025-03-04T03:17:35.114ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14292025-03-04T03:17:35.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.032668305s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
14302025-03-04T03:17:35.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 796.229564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
14312025-03-04T03:17:35.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 932.560945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
14322025-03-04T03:17:35.407ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 52.548006ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14332025-03-04T03:17:35.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 754.678692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
14342025-03-04T03:17:35.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 620.769025ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14352025-03-04T03:17:35.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 62.74805ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14362025-03-04T03:17:35.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 128.612361ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14372025-03-04T03:17:35.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 70.498913ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14382025-03-04T03:17:35.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 880.122333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
14392025-03-04T03:17:35.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.463747809s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14402025-03-04T03:17:35.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 269.248938ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14412025-03-04T03:17:35.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 118.706236ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14422025-03-04T03:17:35.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.00764478s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14432025-03-04T03:17:35.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 1.135867814s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
14442025-03-04T03:17:35.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.403232468s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
14452025-03-04T03:17:35.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 329.457347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14462025-03-04T03:17:35.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 1.222724676s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
14472025-03-04T03:17:35.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 303.3684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14482025-03-04T03:17:36.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 975.960916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
14492025-03-04T03:17:36.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 977.290436ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
14502025-03-04T03:17:36.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 877.317749ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14512025-03-04T03:17:36.102ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 967.816028ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14522025-03-04T03:17:36.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 721.505103ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
14532025-03-04T03:17:36.194ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.184442044s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
14542025-03-04T03:17:36.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 974.227537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
14552025-03-04T03:17:36.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.120522599s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14562025-03-04T03:17:36.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 818.284946ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
14572025-03-04T03:17:36.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 794.519584ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
14582025-03-04T03:17:36.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 836.035756ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
14592025-03-04T03:17:36.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.07218124s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14602025-03-04T03:17:36.816ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14612025-03-04T03:17:36.817ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14622025-03-04T03:17:36.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 955.724241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
14632025-03-04T03:17:36.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 611.774952ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
14642025-03-04T03:17:36.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 1.390934862s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
14652025-03-04T03:17:36.987ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14662025-03-04T03:17:36.987ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14672025-03-04T03:17:37.007ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 977.19014ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
14682025-03-04T03:17:37.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 547.633208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
14692025-03-04T03:17:37.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 1.47267406s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
14702025-03-04T03:17:37.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.493802878s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
14712025-03-04T03:17:37.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 902.12805ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14722025-03-04T03:17:37.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.123679843s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14732025-03-04T03:17:37.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 1.210578218s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
14742025-03-04T03:17:37.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 60.539563ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14752025-03-04T03:17:37.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 613.394384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
14762025-03-04T03:17:37.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 138.572437ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14772025-03-04T03:17:37.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 637.576603ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
14782025-03-04T03:17:37.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 44.3768ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14792025-03-04T03:17:37.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 785.272248ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
14802025-03-04T03:17:37.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 70.144692ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14812025-03-04T03:17:37.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 172.5485ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14822025-03-04T03:17:37.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.102250325s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
14832025-03-04T03:17:37.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 988.391518ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
14842025-03-04T03:17:37.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 248.761995ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14852025-03-04T03:17:37.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.363103662s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
14862025-03-04T03:17:37.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 342.747336ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14872025-03-04T03:17:37.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 702.531001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
14882025-03-04T03:17:37.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 574.304086ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14892025-03-04T03:17:37.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.283330669s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
14902025-03-04T03:17:37.790ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.181321271s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
14912025-03-04T03:17:37.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 582.624322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
14922025-03-04T03:17:37.957ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.393849235s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
14932025-03-04T03:17:37.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 1.116740056s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
14942025-03-04T03:17:38.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.218452324s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
14952025-03-04T03:17:38.027ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 667.470012ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
14962025-03-04T03:17:38.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 819.308864ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
14972025-03-04T03:17:38.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 869.742154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
14982025-03-04T03:17:38.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 932.707371ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
14992025-03-04T03:17:38.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 938.478205ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15002025-03-04T03:17:38.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 869.235098ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15012025-03-04T03:17:38.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 1.236395722s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15022025-03-04T03:17:38.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 615.219332ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15032025-03-04T03:17:38.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 907.872678ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
15042025-03-04T03:17:38.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 747.518872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15052025-03-04T03:17:38.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 580.788146ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15062025-03-04T03:17:38.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.044627414s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
15072025-03-04T03:17:38.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 1.278663026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
15082025-03-04T03:17:38.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 850.673292ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
15092025-03-04T03:17:38.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 1.425894221s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
15102025-03-04T03:17:38.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.33199137s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15112025-03-04T03:17:39.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.279194417s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
15122025-03-04T03:17:39.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 919.664975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15132025-03-04T03:17:39.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 1.432570707s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
15142025-03-04T03:17:39.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 976.114711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
15152025-03-04T03:17:39.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 671.656898ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15162025-03-04T03:17:39.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.271090114s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
15172025-03-04T03:17:39.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 901.963741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15182025-03-04T03:17:39.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.473124812s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
15192025-03-04T03:17:39.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.057184596s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15202025-03-04T03:17:39.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 670.167075ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15212025-03-04T03:17:39.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.274555359s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
15222025-03-04T03:17:39.398ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 1.349647574s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
15232025-03-04T03:17:39.645ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.351719365s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
15242025-03-04T03:17:39.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 960.816982ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15252025-03-04T03:17:39.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.339931059s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
15262025-03-04T03:17:39.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 617.381611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15272025-03-04T03:17:39.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 1.372489585s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15282025-03-04T03:17:40.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 1.460463793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
15292025-03-04T03:17:40.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 628.364576ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15302025-03-04T03:17:40.116ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 595.823461ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
15312025-03-04T03:17:40.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 576.153174ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15322025-03-04T03:17:40.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.008356437s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15332025-03-04T03:17:40.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.482847993s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15342025-03-04T03:17:40.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 595.214163ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
15352025-03-04T03:17:40.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 985.296008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
15362025-03-04T03:17:40.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 1.274895303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15372025-03-04T03:17:40.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 744.170518ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
15382025-03-04T03:17:40.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 1.060680033s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
15392025-03-04T03:17:40.634ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 1.175066295s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15402025-03-04T03:17:40.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.424977102s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
15412025-03-04T03:17:40.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 727.239548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15422025-03-04T03:17:40.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 662.946209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
15432025-03-04T03:17:40.732ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15442025-03-04T03:17:40.733ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15452025-03-04T03:17:40.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.050407139s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
15462025-03-04T03:17:40.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 901.977869ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15472025-03-04T03:17:40.786ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 989.308777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
15482025-03-04T03:17:40.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 869.540331ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
15492025-03-04T03:17:41.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.348397907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
15502025-03-04T03:17:41.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 39.598358ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15512025-03-04T03:17:41.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 102.375568ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15522025-03-04T03:17:41.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.381674651s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
15532025-03-04T03:17:41.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 120.887624ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15542025-03-04T03:17:41.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 587.362282ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
15552025-03-04T03:17:41.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 368.887695ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15562025-03-04T03:17:41.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 803.182287ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15572025-03-04T03:17:41.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 932.350367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15582025-03-04T03:17:41.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 865.843429ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15592025-03-04T03:17:41.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 755.42386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
15602025-03-04T03:17:41.504ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80") failed: Property not found. retry in 1.185192253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
15612025-03-04T03:17:41.515ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 802.231449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
15622025-03-04T03:17:41.631ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 1.234267962s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
15632025-03-04T03:17:41.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 600.397271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15642025-03-04T03:17:41.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 864.426095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15652025-03-04T03:17:41.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 990.714985ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
15662025-03-04T03:17:41.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 653.052225ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15672025-03-04T03:17:41.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.269883056s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
15682025-03-04T03:17:41.854ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 690.976761ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15692025-03-04T03:17:41.871ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 553.583527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15702025-03-04T03:17:41.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 710.380934ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
15712025-03-04T03:17:41.899ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.442128099s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
15722025-03-04T03:17:42.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.410431289s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
15732025-03-04T03:17:42.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.493664484s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
15742025-03-04T03:17:42.282ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 615.933608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15752025-03-04T03:17:42.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1") failed: Property not found. retry in 891.522345ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
15762025-03-04T03:17:42.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 1.326356178s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
15772025-03-04T03:17:42.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.440864277s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
15782025-03-04T03:17:42.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 832.892002ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
15792025-03-04T03:17:42.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 751.267167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15802025-03-04T03:17:42.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 879.353264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15812025-03-04T03:17:42.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 914.717317ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
15822025-03-04T03:17:42.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 873.63546ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15832025-03-04T03:17:42.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 866.312182ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15842025-03-04T03:17:42.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.312617908s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
15852025-03-04T03:17:42.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 1.194883341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
15862025-03-04T03:17:42.799ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8") failed: Property not found. retry in 1.387319505s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
15872025-03-04T03:17:42.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 685.252274ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
15882025-03-04T03:17:42.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 648.881211ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15892025-03-04T03:17:43.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.356913303s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
15902025-03-04T03:17:43.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 1.042464818s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
15912025-03-04T03:17:43.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 922.841762ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
15922025-03-04T03:17:43.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 984.491957ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
15932025-03-04T03:17:43.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 607.534482ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
15942025-03-04T03:17:43.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 857.275106ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
15952025-03-04T03:17:43.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 569.206176ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
15962025-03-04T03:17:43.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 554.932454ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
15972025-03-04T03:17:43.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 874.627106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
15982025-03-04T03:17:43.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.303331899s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
15992025-03-04T03:17:43.590ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 562.555564ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16002025-03-04T03:17:43.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95") failed: Property not found. retry in 1.274873107s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
16012025-03-04T03:17:43.770ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 860.721356ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16022025-03-04T03:17:43.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 545.159068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16032025-03-04T03:17:43.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b") failed: Property not found. retry in 759.266924ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
16042025-03-04T03:17:43.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.171627879s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16052025-03-04T03:17:43.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.065596574s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16062025-03-04T03:17:44.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 518.72473ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16072025-03-04T03:17:44.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 1.160480083s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16082025-03-04T03:17:44.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 757.480786ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16092025-03-04T03:17:44.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 694.118707ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16102025-03-04T03:17:44.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5") failed: Property not found. retry in 1.148991932s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
16112025-03-04T03:17:44.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.481411435s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16122025-03-04T03:17:44.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 873.092326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16132025-03-04T03:17:44.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.260140704s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16142025-03-04T03:17:44.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 589.761888ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16152025-03-04T03:17:44.494ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.417315496s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
16162025-03-04T03:17:44.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 771.480424ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16172025-03-04T03:17:44.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.420618253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16182025-03-04T03:17:44.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 948.193718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16192025-03-04T03:17:44.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.00594817s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
16202025-03-04T03:17:44.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 968.346019ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16212025-03-04T03:17:45.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.093778101s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16222025-03-04T03:17:45.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 705.26496ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16232025-03-04T03:17:45.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 817.309081ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16242025-03-04T03:17:45.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.209207042s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16252025-03-04T03:17:45.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 627.582725ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16262025-03-04T03:17:45.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.069124964s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16272025-03-04T03:17:45.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.162400886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16282025-03-04T03:17:45.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.259523001s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16292025-03-04T03:17:45.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 877.615859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16302025-03-04T03:17:45.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.044533738s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
16312025-03-04T03:17:45.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 505.587308ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16322025-03-04T03:17:45.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.445239629s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
16332025-03-04T03:17:45.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 624.813907ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16342025-03-04T03:17:46.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 636.439713ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16352025-03-04T03:17:46.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 571.189706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16362025-03-04T03:17:46.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 831.747747ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16372025-03-04T03:17:46.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 665.459304ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16382025-03-04T03:17:46.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.081931157s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16392025-03-04T03:17:46.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 848.697176ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16402025-03-04T03:17:46.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 704.032983ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16412025-03-04T03:17:46.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.146641497s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16422025-03-04T03:17:46.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.464033169s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16432025-03-04T03:17:46.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 631.371353ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16442025-03-04T03:17:46.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.472384833s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16452025-03-04T03:17:46.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.077545263s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16462025-03-04T03:17:46.961ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d") failed: Property not found. retry in 1.479047933s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
16472025-03-04T03:17:46.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 1.150190593s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16482025-03-04T03:17:47.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.21442116s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16492025-03-04T03:17:47.057ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.165946618s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16502025-03-04T03:17:47.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.053348728s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16512025-03-04T03:17:47.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 660.904197ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16522025-03-04T03:17:47.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 523.226141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16532025-03-04T03:17:47.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.249705097s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
16542025-03-04T03:17:47.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.090231623s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16552025-03-04T03:17:47.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.148244147s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16562025-03-04T03:17:47.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.032360579s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16572025-03-04T03:17:47.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.226261498s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16582025-03-04T03:17:47.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 885.331345ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16592025-03-04T03:17:48.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.181611507s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16602025-03-04T03:17:48.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 717.373821ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16612025-03-04T03:17:48.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 771.842963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16622025-03-04T03:17:48.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 1.34923439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16632025-03-04T03:17:48.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 744.910124ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16642025-03-04T03:17:48.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 981.30097ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16652025-03-04T03:17:48.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.095160043s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16662025-03-04T03:17:48.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 926.620552ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
16672025-03-04T03:17:48.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 1.140701789s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16682025-03-04T03:17:48.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 817.929475ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16692025-03-04T03:17:48.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.132510144s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16702025-03-04T03:17:48.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a") failed: Property not found. retry in 1.445801971s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
16712025-03-04T03:17:48.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 626.232637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16722025-03-04T03:17:48.997ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 886.996345ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16732025-03-04T03:17:49.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.046374989s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16742025-03-04T03:17:49.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762") failed: Property not found. retry in 1.115387158s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
16752025-03-04T03:17:49.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.09740592s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16762025-03-04T03:17:49.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6") failed: Property not found. retry in 880.094847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16772025-03-04T03:17:49.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 573.609664ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16782025-03-04T03:17:49.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882") failed: Property not found. retry in 602.694965ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
16792025-03-04T03:17:49.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2") failed: Property not found. retry in 1.326798158s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
16802025-03-04T03:17:49.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7") failed: Property not found. retry in 1.008416098s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
16812025-03-04T03:17:49.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 678.629956ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16822025-03-04T03:17:49.908ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 31.774592921s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
16832025-03-04T03:17:50.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e") failed: Property not found. retry in 520.357956ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
16842025-03-04T03:17:50.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8") failed: Property not found. retry in 1.18523544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
16852025-03-04T03:17:50.193ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3") failed: Property not found. retry in 1.402247376s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
16862025-03-04T03:17:50.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30") failed: Property not found. retry in 1.131874278s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
16872025-03-04T03:17:50.425ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5") failed: Property not found. retry in 1.278831484s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
16882025-03-04T03:17:50.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 886.8172ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16892025-03-04T03:17:51.337ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61786
16902025-03-04T03:17:51.404ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61786 req_id = 21fd38b0-35ac-4b37-b637-1c768047a685 response_code = 200 uri = /baseboard
16912025-03-04T03:17:51.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.290663394s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16922025-03-04T03:17:52.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 997.927818ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16932025-03-04T03:17:53.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.42907333s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16942025-03-04T03:17:55.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 865.136756ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16952025-03-04T03:17:56.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c") failed: Property not found. retry in 1.454996324s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
16962025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_c870825c-4dd8-4d30-bee2-21e2e79525a6
16972025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_pantry_ff5593fa-b539-4a70-bfa5-8ea58fcd766d
16982025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_bcef9acd-8e55-4275-aeea-1bfdc7ee15a5
16992025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_external_dns_72700cb3-c938-46f0-9b9c-46cf389d975e
17002025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_nexus_c28b34ab-1b39-4325-87ad-c4ccf5b009d5
17012025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_ad8b3774-89b6-46eb-84b1-cdb031c615c3
17022025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_clickhouse_5eaa31d5-c53c-4a12-9056-f7a4d016f45c
17032025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_d9eb5323-cf50-4e0a-a06d-d1f5284086b8
17042025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_99c546d1-d487-413a-bbeb-feee972c9a30
17052025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_pantry_05cdc36e-5e5c-48ec-8400-66f9d706ea80
17062025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_nexus_d8484452-7d43-42ac-a588-575b6d31b882
17072025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_pantry_24d39e5f-f5d7-40f5-b48a-2fc33313f762
17082025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_8191d28f-a54d-4432-b5b1-39f2a89113a1
17092025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_7b769dfa-f11a-47f4-9620-313afcc6dd95
17102025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_4b91bdf4-f908-4ddf-aa8d-aca173e8f4a8
17112025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_oximeter_ea0fb0f5-7b4c-4550-9130-b713c9ef0c9a
17122025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_crucible_382dd280-976a-45c5-b45f-5de9952f556b
17132025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_external_dns_0e2dad65-6466-48b5-bc3a-8a9f5178c9b7
17142025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3419 zone = oxz_nexus_2afd3cd1-228b-4949-95e6-cb3413cc5ec2
17152025-03-04T03:17:57.780ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17162025-03-04T03:17:57.785ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17172025-03-04T03:17:57.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36469034 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34808 req_id = 91a3e95f-2412-43d4-8ccf-4819ff60d730 response_code = 204 uri = /omicron-zones
17182025-03-04T03:17:57.800ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1402
17192025-03-04T03:17:57.942ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:791
17202025-03-04T03:17:57.947ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:804
17212025-03-04T03:17:57.979ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1004
17222025-03-04T03:17:57.981ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17232025-03-04T03:17:58.130ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17242025-03-04T03:17:58.234ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17252025-03-04T03:17:58.324ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17262025-03-04T03:17:58.487ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17272025-03-04T03:17:58.696ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17282025-03-04T03:17:59.029ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17292025-03-04T03:17:59.311ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17302025-03-04T03:17:59.628ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17312025-03-04T03:18:00.033ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17322025-03-04T03:18:00.568ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17332025-03-04T03:18:01.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17342025-03-04T03:18:01.910ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/accfd3a5-958c-4905-8c5c-5f2ac43dda05/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
17352025-03-04T03:18:04.715ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5c726666-9e37-4a22-8694-76f487170777", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"accfd3a5-958c-4905-8c5c-5f2ac43dda05\"", request_id: "5c726666-9e37-4a22-8694-76f487170777" } file = sled-agent/src/rack_setup/service.rs:1066
17362025-03-04T03:18:05.458ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a0cd3fd0-60eb-4bf6-9499-44bd164b80c3", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"accfd3a5-958c-4905-8c5c-5f2ac43dda05\"", request_id: "a0cd3fd0-60eb-4bf6-9499-44bd164b80c3" } file = sled-agent/src/rack_setup/service.rs:1066
17372025-03-04T03:18:06.468ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9d0da185-bcef-4590-9249-d36f7ee9ccbd", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"accfd3a5-958c-4905-8c5c-5f2ac43dda05\"", request_id: "9d0da185-bcef-4590-9249-d36f7ee9ccbd" } file = sled-agent/src/rack_setup/service.rs:1066
17382025-03-04T03:18:07.520ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "995152ea-2f8f-4903-9c49-fad780c5ad21", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"accfd3a5-958c-4905-8c5c-5f2ac43dda05\"", request_id: "995152ea-2f8f-4903-9c49-fad780c5ad21" } file = sled-agent/src/rack_setup/service.rs:1066
17392025-03-04T03:18:10.450ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6de912ac-8630-4029-93cb-dfb4ea3c9d1d", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "6de912ac-8630-4029-93cb-dfb4ea3c9d1d" } file = sled-agent/src/rack_setup/service.rs:1066
17402025-03-04T03:18:12.631ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "91b184ca-7027-471b-b1ff-a254df4e549a", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "91b184ca-7027-471b-b1ff-a254df4e549a" } file = sled-agent/src/rack_setup/service.rs:1066
17412025-03-04T03:18:14.825ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "aa17dfd2-2a31-4270-a61a-323827af4f10", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "aa17dfd2-2a31-4270-a61a-323827af4f10" } file = sled-agent/src/rack_setup/service.rs:1066
17422025-03-04T03:18:19.374ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c6507ffa-8ad6-4bf9-b863-4c4902ef7c2a", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "c6507ffa-8ad6-4bf9-b863-4c4902ef7c2a" } file = sled-agent/src/rack_setup/service.rs:1066
17432025-03-04T03:18:21.444ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47988
17442025-03-04T03:18:21.444ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47988 req_id = 8e41e6b4-4fce-4f9c-8ce7-68ca69f28d62 response_code = 200 uri = /baseboard
17452025-03-04T03:18:24.470ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3d1da42b-5f60-470e-b47f-77177b60efa1", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "3d1da42b-5f60-470e-b47f-77177b60efa1" } file = sled-agent/src/rack_setup/service.rs:1066
17462025-03-04T03:18:29.638ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3053cc81-adee-49be-9e8b-f1be3c80a851", "content-length": "173", "date": "Tue, 04 Mar 2025 03:18:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"5525e426-7299-43ab-ad2b-346968b24e1c\"", request_id: "3053cc81-adee-49be-9e8b-f1be3c80a851" } file = sled-agent/src/rack_setup/service.rs:1066
17472025-03-04T03:18:30.821ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
17482025-03-04T03:18:30.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37194
17492025-03-04T03:18:30.910ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17502025-03-04T03:18:30.910ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17512025-03-04T03:18:30.910ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
17522025-03-04T03:18:30.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
17532025-03-04T03:18:30.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17542025-03-04T03:18:30.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3
17552025-03-04T03:18:30.950ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17562025-03-04T03:18:30.950ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8bf53b00-dedd-4516-be68-25e52e3985f5
17572025-03-04T03:18:30.972ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17582025-03-04T03:18:30.972ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725
17592025-03-04T03:18:30.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17602025-03-04T03:18:30.992ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_92e4d589-1042-4d5f-a963-b670e19540f9
17612025-03-04T03:18:31.016ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17622025-03-04T03:18:31.016ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40
17632025-03-04T03:18:31.041ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17642025-03-04T03:18:31.041ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_ce1d8eb5-4250-40ee-a991-35c54c086636
17652025-03-04T03:18:31.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662025-03-04T03:18:31.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26
17672025-03-04T03:18:31.082ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17682025-03-04T03:18:31.082ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797
17692025-03-04T03:18:31.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702025-03-04T03:18:31.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf
17712025-03-04T03:18:31.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37194 req_id = 8a89a159-f82a-4be8-b207-0e6924561dd8 response_code = 200 uri = /inventory
17722025-03-04T03:18:37.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33247
17732025-03-04T03:18:37.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33247 req_id = d4e4ab7a-b138-4bc1-996b-f53285e1616b response_code = 200 uri = /vpc-routes
17742025-03-04T03:18:38.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
17752025-03-04T03:18:38.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33247 req_id = e087cdf8-6c95-4c06-92c0-067cd3959e12 response_code = 204 uri = /eip-gateways
17762025-03-04T03:18:38.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62559
17772025-03-04T03:18:38.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62559 req_id = b3d1c50e-e25f-44ae-9dad-99061b3d8836 response_code = 200 uri = /v2p
17782025-03-04T03:18:38.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1849 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33247 req_id = 23d676fb-45f3-4b33-908d-0f3484deba4c response_code = 204 uri = /vpc-routes
17792025-03-04T03:18:38.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43170
17802025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17812025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17822025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17832025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17842025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17852025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17862025-03-04T03:18:38.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17872025-03-04T03:18:38.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1514 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43170 req_id = 8a6ba0a2-dad7-4311-9138-d6473c6b74bc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17882025-03-04T03:18:38.541ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1076
17892025-03-04T03:18:38.545ZINFOSledAgent (RSS): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
17902025-03-04T03:18:38.546ZINFOSledAgent (RSS): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
17912025-03-04T03:18:38.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57765
17922025-03-04T03:18:38.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57765 req_id = 1f35048f-7a94-4b26-84e1-9bc55443237a response_code = 200 uri = /vpc-routes
17932025-03-04T03:18:38.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57836
17942025-03-04T03:18:38.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17952025-03-04T03:18:38.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17962025-03-04T03:18:38.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
17972025-03-04T03:18:38.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
17982025-03-04T03:18:38.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17992025-03-04T03:18:38.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3
18002025-03-04T03:18:38.933ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18012025-03-04T03:18:38.933ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8bf53b00-dedd-4516-be68-25e52e3985f5
18022025-03-04T03:18:38.961ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18032025-03-04T03:18:38.961ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725
18042025-03-04T03:18:38.986ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18052025-03-04T03:18:38.986ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_92e4d589-1042-4d5f-a963-b670e19540f9
18062025-03-04T03:18:39.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18072025-03-04T03:18:39.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40
18082025-03-04T03:18:39.038ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18092025-03-04T03:18:39.038ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_ce1d8eb5-4250-40ee-a991-35c54c086636
18102025-03-04T03:18:39.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18112025-03-04T03:18:39.070ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26
18122025-03-04T03:18:39.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18132025-03-04T03:18:39.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797
18142025-03-04T03:18:39.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
18152025-03-04T03:18:39.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57765 req_id = 8a27fa5f-848d-4b1b-bb41-775053d5315f response_code = 204 uri = /eip-gateways
18162025-03-04T03:18:39.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18172025-03-04T03:18:39.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf
18182025-03-04T03:18:39.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57836 req_id = 1bd9f1d5-65d9-49c3-8cb8-7c6c020d250c response_code = 200 uri = /inventory
18192025-03-04T03:18:39.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57765 req_id = 11bc767f-4a0c-425f-a4b5-647ed0b58c35 response_code = 204 uri = /vpc-routes
18202025-03-04T03:18:39.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57294
18212025-03-04T03:18:39.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57294 req_id = 4e350b50-aceb-4f41-a099-bba0a9590f89 response_code = 200 uri = /v2p
18222025-03-04T03:18:39.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41927
18232025-03-04T03:18:39.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41927 req_id = 88c04efb-4b66-4158-9708-bc76e33d31df response_code = 200 uri = /vpc-routes
18242025-03-04T03:18:39.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62352
18252025-03-04T03:18:39.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
18262025-03-04T03:18:39.450ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
18272025-03-04T03:18:39.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192027 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62352 req_id = 77c093b7-cc11-48c3-94fd-db08660f0eab response_code = 204 uri = /switch-ports
18282025-03-04T03:18:39.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35009
18292025-03-04T03:18:39.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
18302025-03-04T03:18:39.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41927 req_id = b7c210e6-ab83-4bf9-8bfd-2f13ffc44890 response_code = 204 uri = /eip-gateways
18312025-03-04T03:18:39.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35485
18322025-03-04T03:18:39.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
18332025-03-04T03:18:39.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35485 req_id = 42f4cd46-d659-4cda-9da7-56b3c1e0eae8 response_code = 200 uri = /v2p
18342025-03-04T03:18:39.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 929 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62352 req_id = 2c5f93ff-8b6e-43b8-bd49-beabf7ad520c response_code = 200 uri = /network-bootstore-config
18352025-03-04T03:18:39.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41927 req_id = 222d5a67-0c98-4e09-b14c-8ed8505867a3 response_code = 204 uri = /vpc-routes
18362025-03-04T03:18:39.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34437
18372025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18382025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18402025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18412025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432025-03-04T03:18:39.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18442025-03-04T03:18:39.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 870 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34437 req_id = aa3e585b-181a-4353-ba6e-ee324aa37bfd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18452025-03-04T03:18:39.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
18462025-03-04T03:18:39.608ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18472025-03-04T03:18:39.608ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
18482025-03-04T03:18:39.609ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
18492025-03-04T03:18:39.611ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18502025-03-04T03:18:39.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62352 req_id = 56ee30d6-b463-41ea-918f-3b9e8a4a14a5 response_code = 204 uri = /network-bootstore-config
18512025-03-04T03:18:39.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43322
18522025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18532025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18552025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18562025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18572025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18582025-03-04T03:18:39.617ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18592025-03-04T03:18:39.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43322 req_id = 46a3482c-e707-49da-a71f-1af05740ff0c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18602025-03-04T03:18:39.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35009 req_id = 0a120158-b404-46d3-846f-207727b42e9f response_code = 204 uri = /switch-ports
18612025-03-04T03:18:39.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35009 req_id = dc36859c-f977-484a-82dc-8b6708d02c87 response_code = 200 uri = /network-bootstore-config
18622025-03-04T03:18:39.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45294
18632025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18642025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18662025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18672025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18682025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18692025-03-04T03:18:39.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18702025-03-04T03:18:39.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45294 req_id = 39b3d345-aa24-496d-b32f-dbcf7a0cf9d6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18712025-03-04T03:18:45.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40329
18722025-03-04T03:18:45.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40329 req_id = f0b46693-bc61-4b9a-9df1-f7047022f309 response_code = 200 uri = /vpc-routes
18732025-03-04T03:18:45.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
18742025-03-04T03:18:45.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40329 req_id = a999926c-9037-4d00-828f-d95a8a42a724 response_code = 204 uri = /eip-gateways
18752025-03-04T03:18:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40329 req_id = 04129e93-df33-467e-8838-c3475146df20 response_code = 204 uri = /vpc-routes
18762025-03-04T03:18:51.487ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51973
18772025-03-04T03:18:51.487ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51973 req_id = 14e2dca9-b40c-44fc-89f5-8dc1b474555a response_code = 200 uri = /baseboard
18782025-03-04T03:19:02.901ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:32804 remote_addr = [fd00:1122:3344:101::d]:64303 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
18792025-03-04T03:19:02.924ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22057 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 606a6fd8-223b-474c-aaf8-30b33978f478 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
18802025-03-04T03:19:07.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59230
18812025-03-04T03:19:07.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59230 req_id = b979eb25-ffbc-40b1-81c8-f79f64518c25 response_code = 200 uri = /vpc-routes
18822025-03-04T03:19:07.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63778
18832025-03-04T03:19:07.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63778 req_id = a5f9fb85-6056-4a7b-9505-2b3597e292a8 response_code = 200 uri = /v2p
18842025-03-04T03:19:07.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
18852025-03-04T03:19:07.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59230 req_id = 6e236b57-2f62-4c32-af12-7ba15cafd074 response_code = 204 uri = /eip-gateways
18862025-03-04T03:19:07.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59230 req_id = 7d6b84f9-ed08-4281-ab2e-b731e72aa7ce response_code = 204 uri = /vpc-routes
18872025-03-04T03:19:07.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53263
18882025-03-04T03:19:07.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
18892025-03-04T03:19:07.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
18902025-03-04T03:19:07.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53263 req_id = 461ecdba-0d7b-40d0-bf78-62e5653f56a5 response_code = 204 uri = /switch-ports
18912025-03-04T03:19:07.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53263 req_id = 6802c104-9a21-447f-9076-21d6388ea78b response_code = 200 uri = /network-bootstore-config
18922025-03-04T03:19:08.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40561
18932025-03-04T03:19:08.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40561 req_id = 89385fb8-1478-4cd7-aefc-41a3eb6749bb response_code = 200 uri = /v2p
18942025-03-04T03:19:08.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43050
18952025-03-04T03:19:08.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43050 req_id = 2ed08350-65ab-429c-b3a1-9d081af6b67e response_code = 200 uri = /vpc-routes
18962025-03-04T03:19:08.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
18972025-03-04T03:19:08.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43050 req_id = 17b34780-c37d-4394-af5c-5c8c797181df response_code = 204 uri = /eip-gateways
18982025-03-04T03:19:08.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43050 req_id = 18445ed1-cd8a-405c-98b8-19e946c7b53a response_code = 204 uri = /vpc-routes
18992025-03-04T03:19:09.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58011
19002025-03-04T03:19:09.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19012025-03-04T03:19:09.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19022025-03-04T03:19:09.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58011 req_id = 33746e58-7ac2-45ef-b9eb-166e63a50aa5 response_code = 204 uri = /switch-ports
19032025-03-04T03:19:09.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64118
19042025-03-04T03:19:09.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64118 req_id = 04f77771-c4aa-49df-a9e9-59b484f06167 response_code = 200 uri = /vpc-routes
19052025-03-04T03:19:09.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58011 req_id = 4a1c26db-10e9-4011-a3e1-e35a076451f2 response_code = 200 uri = /network-bootstore-config
19062025-03-04T03:19:09.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19072025-03-04T03:19:09.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64118 req_id = 1c18b751-79a7-437c-9930-a6d34e38a942 response_code = 204 uri = /eip-gateways
19082025-03-04T03:19:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64118 req_id = fd7d0ecd-28bb-4ad6-997e-a50416bbd4cf response_code = 204 uri = /vpc-routes
19092025-03-04T03:19:09.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54858
19102025-03-04T03:19:09.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54858 req_id = 519adc78-6825-41ee-bbd5-2cbf9b4574c1 response_code = 200 uri = /v2p
19112025-03-04T03:19:09.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34506
19122025-03-04T03:19:09.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19132025-03-04T03:19:09.324ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19142025-03-04T03:19:09.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34506 req_id = 76e26fa3-3422-492c-867a-75b031f3107d response_code = 204 uri = /switch-ports
19152025-03-04T03:19:09.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34506 req_id = 57752c79-844c-426f-a350-f85c84fa4008 response_code = 200 uri = /network-bootstore-config
19162025-03-04T03:19:21.521ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46121
19172025-03-04T03:19:21.521ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46121 req_id = 03eba8c6-e669-4631-9fc0-439f307f975e response_code = 200 uri = /baseboard
19182025-03-04T03:19:32.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4906 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 76eb5125-63fe-4a69-b87a-02d19bc51def response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
19192025-03-04T03:19:37.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53794
19202025-03-04T03:19:37.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53794 req_id = 1aa38ccc-17a0-4dca-bb1f-58e812b9f556 response_code = 200 uri = /vpc-routes
19212025-03-04T03:19:37.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19222025-03-04T03:19:37.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53794 req_id = b0529d48-3855-4956-b7e6-d298b0f639bf response_code = 204 uri = /eip-gateways
19232025-03-04T03:19:37.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53794 req_id = e7d89cd3-f297-452b-ad12-9d5e4e36c03f response_code = 204 uri = /vpc-routes
19242025-03-04T03:19:37.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60863
19252025-03-04T03:19:37.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60863 req_id = 55c50719-2983-4ddd-b84b-f57d90ea811a response_code = 200 uri = /v2p
19262025-03-04T03:19:37.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35834
19272025-03-04T03:19:37.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19282025-03-04T03:19:37.598ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19292025-03-04T03:19:37.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35834 req_id = e9859318-32c8-460c-89ee-d968997e0a9d response_code = 204 uri = /switch-ports
19302025-03-04T03:19:37.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35834 req_id = 0386caeb-5433-422f-b5a7-5bfb886a0f35 response_code = 200 uri = /network-bootstore-config
19312025-03-04T03:19:38.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36671
19322025-03-04T03:19:38.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36671 req_id = f555e100-3f3d-4c24-bd8e-10edb3846938 response_code = 200 uri = /vpc-routes
19332025-03-04T03:19:38.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19342025-03-04T03:19:38.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36671 req_id = 1d8e8667-0bc6-4305-b9d3-cf3f3caa3154 response_code = 204 uri = /eip-gateways
19352025-03-04T03:19:38.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61507
19362025-03-04T03:19:38.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61507 req_id = 4a76e0aa-c09f-4cf4-a879-1cccf39f58c0 response_code = 200 uri = /v2p
19372025-03-04T03:19:38.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36671 req_id = 0a0fd9e4-a062-4975-a3ae-cc874a05b7bf response_code = 204 uri = /vpc-routes
19382025-03-04T03:19:38.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64369
19392025-03-04T03:19:38.906ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19402025-03-04T03:19:38.945ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19412025-03-04T03:19:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64369 req_id = d4a5931d-c96b-4e1b-9122-3eff1986811e response_code = 204 uri = /switch-ports
19422025-03-04T03:19:39.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53446
19432025-03-04T03:19:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53446 req_id = bd7b1c95-5177-4ffd-80ae-09e0b08e91c8 response_code = 200 uri = /vpc-routes
19442025-03-04T03:19:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64369 req_id = e3dc0ff1-5844-4a22-a172-7fb195ba7bd1 response_code = 200 uri = /network-bootstore-config
19452025-03-04T03:19:39.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19462025-03-04T03:19:39.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53446 req_id = 9b74de29-e516-49dd-ac90-96756404a2cb response_code = 204 uri = /eip-gateways
19472025-03-04T03:19:39.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43543
19482025-03-04T03:19:39.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43543 req_id = 828ceb6a-fe8d-4f73-8b9a-51fdec192391 response_code = 200 uri = /v2p
19492025-03-04T03:19:39.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53446 req_id = e925a3da-e5dc-42f8-abe4-26e89a1f0c16 response_code = 204 uri = /vpc-routes
19502025-03-04T03:19:39.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40017
19512025-03-04T03:19:39.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19522025-03-04T03:19:39.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19532025-03-04T03:19:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40017 req_id = 896d9028-78e7-4e37-9180-8562f32c1755 response_code = 204 uri = /switch-ports
19542025-03-04T03:19:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40017 req_id = aa59be20-915a-409b-a529-97559861c83f response_code = 200 uri = /network-bootstore-config
19552025-03-04T03:19:51.553ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33728
19562025-03-04T03:19:51.554ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33728 req_id = 0fb7d546-8919-4a65-85f1-3dd37021c285 response_code = 200 uri = /baseboard
19572025-03-04T03:20:01.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
19582025-03-04T03:20:02.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5809 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 9ea8be1c-c014-4a90-8efc-738b289fbac0 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
19592025-03-04T03:20:07.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60259
19602025-03-04T03:20:07.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60259 req_id = 2cfdba83-2b4a-43e4-9551-c6c0423b748b response_code = 200 uri = /vpc-routes
19612025-03-04T03:20:07.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19622025-03-04T03:20:07.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60259 req_id = fc92133f-cf61-4a0e-a37f-bf1a8ab85307 response_code = 204 uri = /eip-gateways
19632025-03-04T03:20:07.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60259 req_id = ff1f455c-66f7-44db-a795-316cbba5c49c response_code = 204 uri = /vpc-routes
19642025-03-04T03:20:07.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40539
19652025-03-04T03:20:07.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40539 req_id = 0b398747-b435-4857-84f0-46077cc6b780 response_code = 200 uri = /v2p
19662025-03-04T03:20:07.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43922
19672025-03-04T03:20:07.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19682025-03-04T03:20:07.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19692025-03-04T03:20:07.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92229 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43922 req_id = 2ee5b19d-a2c9-4c2f-80f7-e838fd475768 response_code = 204 uri = /switch-ports
19702025-03-04T03:20:07.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43922 req_id = 109041b8-4b7b-49fe-a2da-21db2549a676 response_code = 200 uri = /network-bootstore-config
19712025-03-04T03:20:08.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58931
19722025-03-04T03:20:08.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58931 req_id = f73a1061-b675-4b45-b6cb-06ceda41d459 response_code = 200 uri = /vpc-routes
19732025-03-04T03:20:09.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19742025-03-04T03:20:09.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58931 req_id = af18d724-863c-4a22-9f17-696d1ad1399c response_code = 204 uri = /eip-gateways
19752025-03-04T03:20:09.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58931 req_id = 485a5cde-c5d4-4d0d-8d53-73ca58f3eed7 response_code = 204 uri = /vpc-routes
19762025-03-04T03:20:09.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48593
19772025-03-04T03:20:09.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19782025-03-04T03:20:09.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19792025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93412 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48593 req_id = 2c7a2e76-abe7-40bb-a030-4b0f7cc3ccd5 response_code = 204 uri = /switch-ports
19802025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37232
19812025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62606
19822025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42691
19832025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42691 req_id = 8b8e3730-c2f7-4256-946c-bc4c8d9ceb1b response_code = 200 uri = /v2p
19842025-03-04T03:20:09.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37232 req_id = c1fa7731-0fd6-4934-ba9b-074fadaa8165 response_code = 200 uri = /v2p
19852025-03-04T03:20:09.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48593 req_id = 6c7cdef8-c359-49f9-a1ff-c97b87d32ebe response_code = 200 uri = /network-bootstore-config
19862025-03-04T03:20:09.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62606 req_id = 33c2cda3-955b-408d-bb96-d79d18bd78f6 response_code = 200 uri = /vpc-routes
19872025-03-04T03:20:09.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
19882025-03-04T03:20:09.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62606 req_id = 0f8e4de0-407f-477b-91e4-12c35f3be7ba response_code = 204 uri = /eip-gateways
19892025-03-04T03:20:09.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62606 req_id = 18c45ed8-c7dd-4e3b-9f58-281a3accb1b6 response_code = 204 uri = /vpc-routes
19902025-03-04T03:20:09.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33032
19912025-03-04T03:20:09.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
19922025-03-04T03:20:09.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
19932025-03-04T03:20:09.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33032 req_id = 2ae70dd8-d621-42cf-90d3-ba5be963248c response_code = 204 uri = /switch-ports
19942025-03-04T03:20:09.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33032 req_id = ba2de789-120f-4f33-bcf4-539ff985ff15 response_code = 200 uri = /network-bootstore-config
19952025-03-04T03:20:21.589ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63818
19962025-03-04T03:20:21.589ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63818 req_id = bf188d79-636e-429b-a4b6-347b3406729c response_code = 200 uri = /baseboard
19972025-03-04T03:20:32.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4995 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 41bd4f9d-cc5e-4823-ae96-3ea07266e923 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
19982025-03-04T03:20:37.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60528
19992025-03-04T03:20:37.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60528 req_id = fe742654-dfea-43f4-a1ce-d9badf771fd1 response_code = 200 uri = /vpc-routes
20002025-03-04T03:20:37.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34262
20012025-03-04T03:20:37.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34262 req_id = 18bf35cb-15f4-4b4d-9fc9-db52f9be1f66 response_code = 200 uri = /v2p
20022025-03-04T03:20:37.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20032025-03-04T03:20:37.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60528 req_id = e2928766-0681-4848-bcf1-12d99aca4673 response_code = 204 uri = /eip-gateways
20042025-03-04T03:20:37.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60528 req_id = 01c830d1-5809-43a0-96de-14c6d195fc6d response_code = 204 uri = /vpc-routes
20052025-03-04T03:20:37.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49262
20062025-03-04T03:20:37.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20072025-03-04T03:20:37.650ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20082025-03-04T03:20:37.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88377 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 6ddfe000-cb94-4ec0-bd65-5b8cbe9dec43 response_code = 204 uri = /switch-ports
20092025-03-04T03:20:37.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 38a97617-a4f0-4e53-965e-29be3303785b response_code = 200 uri = /network-bootstore-config
20102025-03-04T03:20:38.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45068
20112025-03-04T03:20:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45068 req_id = 0139e3ba-0cd6-4245-a6b8-fda20d02d113 response_code = 200 uri = /vpc-routes
20122025-03-04T03:20:38.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20132025-03-04T03:20:38.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45068 req_id = 4c32b673-c3ac-4ba9-8b4d-7ed5bb84e3c6 response_code = 204 uri = /eip-gateways
20142025-03-04T03:20:38.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56532
20152025-03-04T03:20:38.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56532 req_id = b70480bd-ced4-4347-b36e-39fdd9a7638e response_code = 200 uri = /v2p
20162025-03-04T03:20:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45068 req_id = 6e05ad59-1f86-4207-a8a6-24777704004f response_code = 204 uri = /vpc-routes
20172025-03-04T03:20:38.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51827
20182025-03-04T03:20:38.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20192025-03-04T03:20:38.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20202025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83649 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51827 req_id = dda0fe6c-bf77-4254-866a-b15daeae9d15 response_code = 204 uri = /switch-ports
20212025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48850
20222025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44198
20232025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44198 req_id = 1cfcd747-a684-4478-b7e7-10c837ce2f38 response_code = 200 uri = /vpc-routes
20242025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51827 req_id = 7b04f054-7657-439d-8c6b-ab3f0e19b331 response_code = 200 uri = /network-bootstore-config
20252025-03-04T03:20:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48850 req_id = 3fd2b4b2-83d9-4d5a-939d-0c03e33211bc response_code = 200 uri = /v2p
20262025-03-04T03:20:39.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20272025-03-04T03:20:39.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44198 req_id = aecdb96a-c9e3-4bb3-b91b-8eeedae92240 response_code = 204 uri = /eip-gateways
20282025-03-04T03:20:39.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44198 req_id = ff4e8622-00b9-4fce-be2b-238ea4992039 response_code = 204 uri = /vpc-routes
20292025-03-04T03:20:39.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47694
20302025-03-04T03:20:39.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20312025-03-04T03:20:39.151ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20322025-03-04T03:20:39.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47694 req_id = 80ab167d-d51e-4776-abea-1b6754580c90 response_code = 204 uri = /switch-ports
20332025-03-04T03:20:39.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47694 req_id = 07b506a9-44b8-4a67-af66-543ab3938455 response_code = 200 uri = /network-bootstore-config
20342025-03-04T03:20:51.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52555
20352025-03-04T03:20:51.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52555 req_id = bb89443d-ea71-497b-b8aa-521d26c40074 response_code = 200 uri = /baseboard
20362025-03-04T03:21:02.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5472 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 2f27f5b6-4350-4bb7-b623-07c1908e9ea3 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
20372025-03-04T03:21:07.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42196
20382025-03-04T03:21:07.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42196 req_id = 1a909af5-f33f-418a-b4c9-64b7e4c76a47 response_code = 200 uri = /vpc-routes
20392025-03-04T03:21:07.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20402025-03-04T03:21:07.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42196 req_id = 3d8282ce-b6c3-4698-b579-9bc9bf300b7a response_code = 204 uri = /eip-gateways
20412025-03-04T03:21:07.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42196 req_id = c5683189-1d1d-46d5-bfe7-d86c0fcdf01c response_code = 204 uri = /vpc-routes
20422025-03-04T03:21:07.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45353
20432025-03-04T03:21:07.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45353 req_id = 76376396-ecc9-4474-9d56-26f2c8c289f6 response_code = 200 uri = /v2p
20442025-03-04T03:21:07.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62619
20452025-03-04T03:21:07.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20462025-03-04T03:21:07.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20472025-03-04T03:21:07.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62619 req_id = 1af8e31c-bf26-434e-a6b9-f25a4d195f80 response_code = 204 uri = /switch-ports
20482025-03-04T03:21:07.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62619 req_id = 69b98726-3c35-459c-9a92-8c347e2f7c37 response_code = 200 uri = /network-bootstore-config
20492025-03-04T03:21:08.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47148
20502025-03-04T03:21:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47148 req_id = 461a30eb-f6df-45e1-adbd-adc6007c87b0 response_code = 200 uri = /vpc-routes
20512025-03-04T03:21:08.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56055
20522025-03-04T03:21:08.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56055 req_id = fba367bd-d085-4ba3-a8c9-7fde45c12076 response_code = 200 uri = /v2p
20532025-03-04T03:21:08.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20542025-03-04T03:21:08.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47148 req_id = 2b965b0f-130d-463d-bc72-c3533fd57d4c response_code = 204 uri = /eip-gateways
20552025-03-04T03:21:08.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47148 req_id = dfc1bf33-073d-4cfe-ac90-0986c0b9f5a7 response_code = 204 uri = /vpc-routes
20562025-03-04T03:21:08.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41177
20572025-03-04T03:21:08.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20582025-03-04T03:21:08.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20592025-03-04T03:21:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41177 req_id = 73fc3e9a-0b32-453e-a0db-c01297c789de response_code = 204 uri = /switch-ports
20602025-03-04T03:21:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41177 req_id = 9f0fade2-5fe6-46ed-9fd5-30bd033d6d83 response_code = 200 uri = /network-bootstore-config
20612025-03-04T03:21:09.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59966
20622025-03-04T03:21:09.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59966 req_id = 0265d2b9-5885-416e-8072-dae847c61a2d response_code = 200 uri = /vpc-routes
20632025-03-04T03:21:09.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20642025-03-04T03:21:09.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59966 req_id = e4f38774-794f-4b40-8730-d6acf88d2ffe response_code = 204 uri = /eip-gateways
20652025-03-04T03:21:09.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37823
20662025-03-04T03:21:09.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37823 req_id = c62604e4-5aef-4f04-bac3-676d5c6efac2 response_code = 200 uri = /v2p
20672025-03-04T03:21:09.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59966 req_id = 84cac931-ea5c-4610-9751-240e58386247 response_code = 204 uri = /vpc-routes
20682025-03-04T03:21:09.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49023
20692025-03-04T03:21:09.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20702025-03-04T03:21:09.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20712025-03-04T03:21:09.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49023 req_id = 512138de-e184-4634-b0e0-f0868ecd9b0c response_code = 204 uri = /switch-ports
20722025-03-04T03:21:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49023 req_id = 78471311-4e43-42cc-adad-70136a956637 response_code = 200 uri = /network-bootstore-config
20732025-03-04T03:21:21.656ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33392
20742025-03-04T03:21:21.657ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33392 req_id = c6c9073f-37c2-431f-8b37-cf03c94bc981 response_code = 200 uri = /baseboard
20752025-03-04T03:21:32.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6569 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 6f0bcbd8-1ca3-4451-adda-32155194f51e response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
20762025-03-04T03:21:37.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63047
20772025-03-04T03:21:37.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63047 req_id = b2bd697a-2683-4a7a-94bb-26fd5b155695 response_code = 200 uri = /vpc-routes
20782025-03-04T03:21:37.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45572
20792025-03-04T03:21:37.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45572 req_id = 92d04149-e5e2-46a9-aa35-d5470129d162 response_code = 200 uri = /v2p
20802025-03-04T03:21:37.515ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20812025-03-04T03:21:37.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63047 req_id = 411da034-bde2-4cdb-8b54-e88e4466bf62 response_code = 204 uri = /eip-gateways
20822025-03-04T03:21:37.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63047 req_id = 7856161f-7654-41d2-965a-f351f4648aac response_code = 204 uri = /vpc-routes
20832025-03-04T03:21:37.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57825
20842025-03-04T03:21:37.536ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20852025-03-04T03:21:37.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20862025-03-04T03:21:37.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92673 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57825 req_id = c046b285-bf40-46fd-9a23-66c46b9540f0 response_code = 204 uri = /switch-ports
20872025-03-04T03:21:37.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57825 req_id = e25c39c0-2e8b-436b-b379-0adb0f586837 response_code = 200 uri = /network-bootstore-config
20882025-03-04T03:21:38.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44494
20892025-03-04T03:21:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44494 req_id = f6d910a1-4150-4110-ab04-654a7f81b05b response_code = 200 uri = /vpc-routes
20902025-03-04T03:21:38.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
20912025-03-04T03:21:38.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44494 req_id = ababa22b-a06d-4c0d-896b-5ecb17932d08 response_code = 204 uri = /eip-gateways
20922025-03-04T03:21:38.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44494 req_id = 57c24a37-8d96-4553-8071-fc80d5e00af3 response_code = 204 uri = /vpc-routes
20932025-03-04T03:21:38.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48905
20942025-03-04T03:21:38.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48905 req_id = 82139ebe-0d51-49a2-a781-61aa71944d8f response_code = 200 uri = /v2p
20952025-03-04T03:21:38.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50724
20962025-03-04T03:21:38.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
20972025-03-04T03:21:38.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
20982025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50724 req_id = 99b9c12c-dad3-4df6-8e10-631b1a25033c response_code = 204 uri = /switch-ports
20992025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54448
21002025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38710
21012025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38710 req_id = 72ea698e-d9b9-4eae-9637-67f23e8b8357 response_code = 200 uri = /v2p
21022025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54448 req_id = 04d67735-9553-4b71-a645-bd61a115a7aa response_code = 200 uri = /vpc-routes
21032025-03-04T03:21:39.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50724 req_id = 5f4b0110-947a-443e-b3a5-ecbd2926ed35 response_code = 200 uri = /network-bootstore-config
21042025-03-04T03:21:39.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21052025-03-04T03:21:39.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54448 req_id = 904fdd73-5e81-486b-a640-da601b7d2bd5 response_code = 204 uri = /eip-gateways
21062025-03-04T03:21:39.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44093
21072025-03-04T03:21:39.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21082025-03-04T03:21:39.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21092025-03-04T03:21:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44093 req_id = f719ba73-923d-420b-b4aa-7eca46574ed0 response_code = 204 uri = /switch-ports
21102025-03-04T03:21:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54448 req_id = 8727bf2b-4467-45c4-ac3f-2edddf4ea6e1 response_code = 204 uri = /vpc-routes
21112025-03-04T03:21:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44093 req_id = 3026a83f-ae73-4b81-b5cd-2b39a3047f7e response_code = 200 uri = /network-bootstore-config
21122025-03-04T03:21:51.689ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44572
21132025-03-04T03:21:51.689ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44572 req_id = e1076fa3-0b32-427a-a500-b9fdc32e6f3c response_code = 200 uri = /baseboard
21142025-03-04T03:22:02.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5192 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 541fd016-7027-480e-8261-5025dd22f10d response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
21152025-03-04T03:22:07.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64912
21162025-03-04T03:22:07.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64912 req_id = dc480c39-5197-43d1-a80f-a720d4605968 response_code = 200 uri = /vpc-routes
21172025-03-04T03:22:07.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58717
21182025-03-04T03:22:07.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58717 req_id = 6e2e5fbb-0ed4-4167-bd33-dcb8d1b2a246 response_code = 200 uri = /v2p
21192025-03-04T03:22:07.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21202025-03-04T03:22:07.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64912 req_id = ce7a2b7e-63e7-4e4d-8556-ec127ffab6ed response_code = 204 uri = /eip-gateways
21212025-03-04T03:22:07.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64912 req_id = 153c5723-2f19-4d98-a5fd-66ff6b4a12a8 response_code = 204 uri = /vpc-routes
21222025-03-04T03:22:07.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54511
21232025-03-04T03:22:07.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21242025-03-04T03:22:07.736ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21252025-03-04T03:22:07.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54511 req_id = bea7a11f-75fd-426f-89f0-c1aa0024fffc response_code = 204 uri = /switch-ports
21262025-03-04T03:22:07.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54511 req_id = adfe59af-fb69-4b47-a87f-1803968a476e response_code = 200 uri = /network-bootstore-config
21272025-03-04T03:22:08.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51440
21282025-03-04T03:22:08.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51440 req_id = 875656cb-e606-4b9c-b91c-79825195332f response_code = 200 uri = /vpc-routes
21292025-03-04T03:22:08.827ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21302025-03-04T03:22:08.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51440 req_id = 530b26fa-c85b-4815-bbbc-df862e7f173f response_code = 204 uri = /eip-gateways
21312025-03-04T03:22:08.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51440 req_id = c19ec5e1-d210-4407-a77d-b9ae6028bdc5 response_code = 204 uri = /vpc-routes
21322025-03-04T03:22:09.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41660
21332025-03-04T03:22:09.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41660 req_id = 7c5bb6cd-3d1b-40b6-9ff9-33cc92292dbb response_code = 200 uri = /v2p
21342025-03-04T03:22:09.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62190
21352025-03-04T03:22:09.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21362025-03-04T03:22:09.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21372025-03-04T03:22:09.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62190 req_id = 274aca17-8ed2-4c9e-95c3-be7cd640a831 response_code = 204 uri = /switch-ports
21382025-03-04T03:22:09.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62190 req_id = 8df4fcc4-1c50-4f31-94cb-3734796b4a97 response_code = 200 uri = /network-bootstore-config
21392025-03-04T03:22:09.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61737
21402025-03-04T03:22:09.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61737 req_id = d9e159b6-b459-4453-96e0-1a9ed4a297f3 response_code = 200 uri = /vpc-routes
21412025-03-04T03:22:09.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21422025-03-04T03:22:09.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61737 req_id = 83afd18c-7770-4923-a71b-12b18291739a response_code = 204 uri = /eip-gateways
21432025-03-04T03:22:09.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34855
21442025-03-04T03:22:09.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34855 req_id = 1c4ab9fc-63c1-418b-a557-3715c85db1f7 response_code = 200 uri = /v2p
21452025-03-04T03:22:09.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61737 req_id = 5ad60288-e2e9-4a42-a2da-8b909ca6369e response_code = 204 uri = /vpc-routes
21462025-03-04T03:22:09.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40616
21472025-03-04T03:22:09.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21482025-03-04T03:22:09.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21492025-03-04T03:22:09.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40616 req_id = a9f7c336-b8c7-4bb8-b185-5b7a403183be response_code = 204 uri = /switch-ports
21502025-03-04T03:22:09.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40616 req_id = 192f7fa9-95c6-469b-8bb9-dd1da106ece1 response_code = 200 uri = /network-bootstore-config
21512025-03-04T03:22:21.722ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48121
21522025-03-04T03:22:21.723ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48121 req_id = 576a6315-30ba-41a2-8952-28ec0e74f939 response_code = 200 uri = /baseboard
21532025-03-04T03:22:32.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6756 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 4a1456e5-6285-4efc-a219-cec8d8d87e67 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
21542025-03-04T03:22:37.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46239
21552025-03-04T03:22:37.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46239 req_id = b0eed021-9696-4974-87f4-ac7838ac644c response_code = 200 uri = /vpc-routes
21562025-03-04T03:22:37.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21572025-03-04T03:22:37.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46239 req_id = fa34e9ce-a57b-4403-a76b-4b64a76e58cd response_code = 204 uri = /eip-gateways
21582025-03-04T03:22:37.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46239 req_id = 73c22914-2c35-472e-90a3-07d0c96507fc response_code = 204 uri = /vpc-routes
21592025-03-04T03:22:37.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55596
21602025-03-04T03:22:37.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55596 req_id = 6f4eb025-e0d5-4844-9286-b1c0068a48c7 response_code = 200 uri = /v2p
21612025-03-04T03:22:37.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54432
21622025-03-04T03:22:37.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21632025-03-04T03:22:37.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21642025-03-04T03:22:37.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54432 req_id = 763e5ab2-9dcc-4212-be80-bee26047c09e response_code = 204 uri = /switch-ports
21652025-03-04T03:22:37.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54432 req_id = 5dc061be-ca29-4a19-a873-1fb78b0e754a response_code = 200 uri = /network-bootstore-config
21662025-03-04T03:22:38.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33956
21672025-03-04T03:22:38.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33956 req_id = f3e54471-62fb-422f-9538-9ac41ab482c2 response_code = 200 uri = /vpc-routes
21682025-03-04T03:22:38.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21692025-03-04T03:22:38.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33956 req_id = f1ad96ea-f657-4c74-852c-0dc9e3021325 response_code = 204 uri = /eip-gateways
21702025-03-04T03:22:38.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33956 req_id = 5fc5bc20-4b4b-4137-a815-c24cde2ad496 response_code = 204 uri = /vpc-routes
21712025-03-04T03:22:38.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65287
21722025-03-04T03:22:38.725ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21732025-03-04T03:22:38.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21742025-03-04T03:22:38.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65287 req_id = ee542f30-cd0f-4676-9a58-d6c1138be51a response_code = 204 uri = /switch-ports
21752025-03-04T03:22:38.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63739
21762025-03-04T03:22:38.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63739 req_id = 3c7199ba-5c10-49eb-907b-d019416bed78 response_code = 200 uri = /v2p
21772025-03-04T03:22:38.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65287 req_id = 1ecefba3-0143-44f5-9704-9e4b67be298f response_code = 200 uri = /network-bootstore-config
21782025-03-04T03:22:39.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40798
21792025-03-04T03:22:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40798 req_id = 4274fb86-e2a3-4dee-b74b-9debe96e2c75 response_code = 200 uri = /vpc-routes
21802025-03-04T03:22:39.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21812025-03-04T03:22:39.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40798 req_id = 205094ef-0d24-4e27-a268-428dc37222b3 response_code = 204 uri = /eip-gateways
21822025-03-04T03:22:39.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40798 req_id = f4fd9b94-9528-48bb-b6b0-5b2fee5667cc response_code = 204 uri = /vpc-routes
21832025-03-04T03:22:39.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45051
21842025-03-04T03:22:39.136ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
21852025-03-04T03:22:39.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
21862025-03-04T03:22:39.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45051 req_id = 4a685eff-c0f2-446d-90f9-7934aa196f17 response_code = 204 uri = /switch-ports
21872025-03-04T03:22:39.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56841
21882025-03-04T03:22:39.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45051 req_id = 8e512322-37cf-4064-8f57-918c89fe1759 response_code = 200 uri = /network-bootstore-config
21892025-03-04T03:22:39.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56841 req_id = 5d6cdde3-a9f1-4b3c-b23d-d45d2dd1be62 response_code = 200 uri = /v2p
21902025-03-04T03:22:51.755ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50331
21912025-03-04T03:22:51.755ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50331 req_id = 45181e34-4a91-47ad-84ec-3c685061236e response_code = 200 uri = /baseboard
21922025-03-04T03:23:02.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7447 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 071d2b21-2806-413c-8cce-28f50b42442a response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
21932025-03-04T03:23:07.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53792
21942025-03-04T03:23:07.584ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21952025-03-04T03:23:07.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53792 req_id = a519e4ab-1dc2-4cde-a271-9da60d35cee4 response_code = 200 uri = /artifacts
21962025-03-04T03:23:07.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39842
21972025-03-04T03:23:07.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39842 req_id = 6a2289fe-c243-43fa-b23e-59c4e15754b4 response_code = 200 uri = /vpc-routes
21982025-03-04T03:23:07.792ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
21992025-03-04T03:23:07.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39842 req_id = 11f22683-41ca-488d-b623-391fc96088a5 response_code = 204 uri = /eip-gateways
22002025-03-04T03:23:07.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39842 req_id = feb170cb-59c6-449e-991c-ded9dcbb7ded response_code = 204 uri = /vpc-routes
22012025-03-04T03:23:07.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51273
22022025-03-04T03:23:07.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51273 req_id = c0d13cd6-609d-4f86-9aa4-17b2791c976b response_code = 200 uri = /v2p
22032025-03-04T03:23:07.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54166
22042025-03-04T03:23:07.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22052025-03-04T03:23:07.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
22062025-03-04T03:23:08.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54166 req_id = 16cc2114-7351-4082-9128-6e11f5fbd7ed response_code = 204 uri = /switch-ports
22072025-03-04T03:23:08.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54166 req_id = 60b43097-f55e-48e1-8b52-f04a2daa6864 response_code = 200 uri = /network-bootstore-config
22082025-03-04T03:23:08.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55361
22092025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22102025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22122025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22132025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22142025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22152025-03-04T03:23:08.098ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22162025-03-04T03:23:08.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 459 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55361 req_id = 3477ad87-206f-4e04-83c8-30125a45ed9e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22172025-03-04T03:23:08.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60020
22182025-03-04T03:23:08.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60020 req_id = cc61c240-76a8-46db-8bb9-4ffe43584092 response_code = 200 uri = /vpc-routes
22192025-03-04T03:23:08.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
22202025-03-04T03:23:08.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60020 req_id = 9671e077-6601-4bd4-9447-afd3c572cdd5 response_code = 204 uri = /eip-gateways
22212025-03-04T03:23:08.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61778
22222025-03-04T03:23:08.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22232025-03-04T03:23:08.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61778 req_id = f9290c62-da7b-4ee1-abf0-e7aba852b919 response_code = 200 uri = /artifacts
22242025-03-04T03:23:08.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60020 req_id = ac95ef53-5a27-4a9b-8b12-b710c8b76a5a response_code = 204 uri = /vpc-routes
22252025-03-04T03:23:08.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56095
22262025-03-04T03:23:08.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22272025-03-04T03:23:09.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
22282025-03-04T03:23:09.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56095 req_id = a7b2f4b1-b6ee-4e0c-9e76-eacaa08df0aa response_code = 204 uri = /switch-ports
22292025-03-04T03:23:09.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54154
22302025-03-04T03:23:09.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54154 req_id = 351b90b6-4132-4d7f-87fd-6d5d532378ca response_code = 200 uri = /v2p
22312025-03-04T03:23:09.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56095 req_id = 5df3fdc6-2268-4c69-8c30-6f567f1db490 response_code = 200 uri = /network-bootstore-config
22322025-03-04T03:23:09.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64973
22332025-03-04T03:23:09.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64973 req_id = 7b3d5de5-75b5-418b-b5c5-a513cc07fbf6 response_code = 200 uri = /vpc-routes
22342025-03-04T03:23:09.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44167
22352025-03-04T03:23:09.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22362025-03-04T03:23:09.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44167 req_id = 6432af7a-d29a-4406-b58b-461152ab4c0e response_code = 200 uri = /artifacts
22372025-03-04T03:23:09.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
22382025-03-04T03:23:09.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64973 req_id = 6eaec8c3-ba25-45d8-9bea-d3d663623c4b response_code = 204 uri = /eip-gateways
22392025-03-04T03:23:09.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47559
22402025-03-04T03:23:09.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47559 req_id = 6ff45f5e-e9bd-49e2-8644-4843fe581bb7 response_code = 200 uri = /v2p
22412025-03-04T03:23:09.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64973 req_id = 9601b082-3904-4866-8579-c6a5338ad649 response_code = 204 uri = /vpc-routes
22422025-03-04T03:23:09.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42718
22432025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22442025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22452025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22462025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22472025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22482025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22492025-03-04T03:23:09.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22502025-03-04T03:23:09.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42718 req_id = 278f4814-91c7-4f65-bca7-b96828ea45fe response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22512025-03-04T03:23:09.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52910
22522025-03-04T03:23:09.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22532025-03-04T03:23:09.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
22542025-03-04T03:23:09.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52910 req_id = e97302fe-68ac-4581-ac67-6fbd152400f3 response_code = 204 uri = /switch-ports
22552025-03-04T03:23:09.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42407
22562025-03-04T03:23:09.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52910 req_id = d7d41ae3-6a5e-4eaf-8358-b2243a142e41 response_code = 200 uri = /network-bootstore-config
22572025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22582025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22592025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22602025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22612025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22622025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22632025-03-04T03:23:09.384ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22642025-03-04T03:23:09.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42407 req_id = d154cf21-9198-47c8-adff-71fbc21578d8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22652025-03-04T03:23:21.788ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43285
22662025-03-04T03:23:21.788ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43285 req_id = ed35a0c5-a1fc-44a0-99d0-078adb032519 response_code = 200 uri = /baseboard
22672025-03-04T03:23:32.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6573 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = c3df9444-3083-49f1-9005-cc64be66d969 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
22682025-03-04T03:23:37.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50770
22692025-03-04T03:23:37.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50770 req_id = bca2a0a4-22c8-4621-945d-7d7ddc9df15f response_code = 200 uri = /vpc-routes
22702025-03-04T03:23:37.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
22712025-03-04T03:23:37.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50770 req_id = b82494a0-90ea-4e4c-b59b-e3c830b9e87b response_code = 204 uri = /eip-gateways
22722025-03-04T03:23:37.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50770 req_id = b67b2725-73b8-4513-ada2-a68fec0ae6e5 response_code = 204 uri = /vpc-routes
22732025-03-04T03:23:37.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39191
22742025-03-04T03:23:37.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22752025-03-04T03:23:37.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
22762025-03-04T03:23:37.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39191 req_id = be68caf3-c4a2-4f29-bcf5-969b11281696 response_code = 204 uri = /switch-ports
22772025-03-04T03:23:37.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37795
22782025-03-04T03:23:37.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37795 req_id = 636c149f-8f9d-47bc-b6c9-93bfef4e5b86 response_code = 200 uri = /v2p
22792025-03-04T03:23:37.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39191 req_id = 3a8f7bb7-f142-443a-b668-a3fff535bb24 response_code = 200 uri = /network-bootstore-config
22802025-03-04T03:23:38.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42311
22812025-03-04T03:23:38.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42311 req_id = 7ac52779-33a1-4f5c-a00b-7d176593a402 response_code = 200 uri = /vpc-routes
22822025-03-04T03:23:38.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
22832025-03-04T03:23:38.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42311 req_id = 8c057ff2-071f-4461-8321-90bfb3198839 response_code = 204 uri = /eip-gateways
22842025-03-04T03:23:38.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44731
22852025-03-04T03:23:38.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44731 req_id = bb612e3b-00d8-447e-8822-3567715bab7b response_code = 200 uri = /v2p
22862025-03-04T03:23:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42311 req_id = d6e00bd7-d184-4f5e-8817-17b613b115dd response_code = 204 uri = /vpc-routes
22872025-03-04T03:23:38.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58093
22882025-03-04T03:23:38.751ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22892025-03-04T03:23:38.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
22902025-03-04T03:23:38.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58093 req_id = ee078add-c6d2-497c-ba9e-a7eec73cb273 response_code = 204 uri = /switch-ports
22912025-03-04T03:23:38.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58093 req_id = f23f8388-5b26-4f8a-ab28-4565daab5bc8 response_code = 200 uri = /network-bootstore-config
22922025-03-04T03:23:38.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61999
22932025-03-04T03:23:38.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61999 req_id = 3dd90eb1-514a-4646-99da-24e74e0be71a response_code = 200 uri = /vpc-routes
22942025-03-04T03:23:39.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
22952025-03-04T03:23:39.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61999 req_id = 15c0f4b0-3e03-4017-88cb-9d3482ad713d response_code = 204 uri = /eip-gateways
22962025-03-04T03:23:39.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61999 req_id = 6409d480-5453-48b2-a7e8-a0984d86a426 response_code = 204 uri = /vpc-routes
22972025-03-04T03:23:39.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36186
22982025-03-04T03:23:39.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
22992025-03-04T03:23:39.092ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23002025-03-04T03:23:39.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36186 req_id = 510a5787-c050-4f96-8bb7-6ff213811377 response_code = 204 uri = /switch-ports
23012025-03-04T03:23:39.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34243
23022025-03-04T03:23:39.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34243 req_id = 9ac1beab-281d-46fa-be8a-79a2c9aa63e2 response_code = 200 uri = /v2p
23032025-03-04T03:23:39.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36186 req_id = 5d9301f4-ea1f-4bd2-a117-e90ee65b096c response_code = 200 uri = /network-bootstore-config
23042025-03-04T03:23:51.821ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39915
23052025-03-04T03:23:51.821ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39915 req_id = cf00aeb3-bb6e-4e07-b7eb-0e65a4fc6cb3 response_code = 200 uri = /baseboard
23062025-03-04T03:24:02.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6556 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = fc581cd2-b37a-4975-8734-00579fe6d584 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
23072025-03-04T03:24:07.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39177
23082025-03-04T03:24:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39177 req_id = 5ab529b4-1f72-44cd-b549-5a02dd8a9ce1 response_code = 200 uri = /vpc-routes
23092025-03-04T03:24:07.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23102025-03-04T03:24:07.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39177 req_id = d8e72ed6-cee0-4b37-93d5-bfdc3b2635e2 response_code = 204 uri = /eip-gateways
23112025-03-04T03:24:07.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39177 req_id = 6b2d7e6e-298f-4a4e-8f19-53dd7766f6da response_code = 204 uri = /vpc-routes
23122025-03-04T03:24:07.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44878
23132025-03-04T03:24:07.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44878 req_id = 2a364363-e08d-469a-9b71-aca6c29c8c16 response_code = 200 uri = /v2p
23142025-03-04T03:24:07.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36647
23152025-03-04T03:24:07.769ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23162025-03-04T03:24:07.807ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23172025-03-04T03:24:07.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36647 req_id = 5979f25f-2eaa-4825-b115-08e39067be92 response_code = 204 uri = /switch-ports
23182025-03-04T03:24:07.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36647 req_id = 0015aafa-e6b9-49d8-92a9-2bc7e3cc58a9 response_code = 200 uri = /network-bootstore-config
23192025-03-04T03:24:08.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39290
23202025-03-04T03:24:08.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39290 req_id = 2bf58cd1-c4fb-46aa-b846-44edc81e44a2 response_code = 200 uri = /vpc-routes
23212025-03-04T03:24:08.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23222025-03-04T03:24:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39290 req_id = 507905fa-8fcc-4ab6-81ba-b95300c8eb9f response_code = 204 uri = /eip-gateways
23232025-03-04T03:24:08.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39290 req_id = feedb0e7-07c1-4a4b-b3c6-ec13cc2d2349 response_code = 204 uri = /vpc-routes
23242025-03-04T03:24:08.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34767
23252025-03-04T03:24:08.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34767 req_id = c1ee9218-31b7-4bf6-9d6c-d1c2ffcb8a2b response_code = 200 uri = /vpc-routes
23262025-03-04T03:24:09.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39017
23272025-03-04T03:24:09.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39017 req_id = 4a2a2645-613c-482e-b7c1-b98585ac1e7d response_code = 200 uri = /v2p
23282025-03-04T03:24:09.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48452
23292025-03-04T03:24:09.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23302025-03-04T03:24:09.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23312025-03-04T03:24:09.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48452 req_id = 21c6ba71-e121-4deb-83d3-1e637bcfbfc9 response_code = 204 uri = /switch-ports
23322025-03-04T03:24:09.150ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23332025-03-04T03:24:09.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34767 req_id = 0d179eac-39d2-49f8-b65d-b484df7829d3 response_code = 204 uri = /eip-gateways
23342025-03-04T03:24:09.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48452 req_id = 9786484d-851e-4dfc-9b1d-5a5a89486a6c response_code = 200 uri = /network-bootstore-config
23352025-03-04T03:24:09.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34767 req_id = 31477075-8155-4105-b3ce-48093d60a66c response_code = 204 uri = /vpc-routes
23362025-03-04T03:24:09.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47193
23372025-03-04T03:24:09.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47193 req_id = 55e1c724-416f-4220-8da0-40ea037506a5 response_code = 200 uri = /v2p
23382025-03-04T03:24:09.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40606
23392025-03-04T03:24:09.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23402025-03-04T03:24:09.273ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23412025-03-04T03:24:09.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40606 req_id = 08c46c08-9bf2-4c94-a51a-7da907e12b92 response_code = 204 uri = /switch-ports
23422025-03-04T03:24:09.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40606 req_id = 457a1e43-42be-49dc-b052-ab3bef7422a8 response_code = 200 uri = /network-bootstore-config
23432025-03-04T03:24:21.852ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53317
23442025-03-04T03:24:21.853ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53317 req_id = ffb8afbc-4a96-4c2b-85d5-fc01f8fe0ef2 response_code = 200 uri = /baseboard
23452025-03-04T03:24:32.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6975 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 59802b10-3656-46bf-a712-93196fc1a346 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
23462025-03-04T03:24:37.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48298
23472025-03-04T03:24:37.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48298 req_id = 00d2fa47-b864-447c-ac66-daff9dec022b response_code = 200 uri = /vpc-routes
23482025-03-04T03:24:37.425ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23492025-03-04T03:24:37.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48298 req_id = 4d0bbccb-9691-4d3e-bd76-c7739de678e1 response_code = 204 uri = /eip-gateways
23502025-03-04T03:24:37.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48298 req_id = ebd4e01a-aa14-4e18-b814-f87e66423b0d response_code = 204 uri = /vpc-routes
23512025-03-04T03:24:37.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57686
23522025-03-04T03:24:37.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57686 req_id = 72c25a89-3f3d-433d-b118-f9ed313ca136 response_code = 200 uri = /v2p
23532025-03-04T03:24:37.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35780
23542025-03-04T03:24:37.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23552025-03-04T03:24:37.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23562025-03-04T03:24:37.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95377 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35780 req_id = f021992c-7a35-42ab-9ba0-17d1dc56e17d response_code = 204 uri = /switch-ports
23572025-03-04T03:24:37.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35780 req_id = 72261daa-7889-429e-8005-2e92d01950da response_code = 200 uri = /network-bootstore-config
23582025-03-04T03:24:38.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34900
23592025-03-04T03:24:38.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34900 req_id = a388ee31-9df5-4c66-9631-b198ec9f5790 response_code = 200 uri = /vpc-routes
23602025-03-04T03:24:38.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23612025-03-04T03:24:38.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34900 req_id = 20b00080-9deb-46a2-a857-9adeab814452 response_code = 204 uri = /eip-gateways
23622025-03-04T03:24:38.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34900 req_id = 65844ef3-88fb-4c62-b863-d9aed82ebee2 response_code = 204 uri = /vpc-routes
23632025-03-04T03:24:38.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37408
23642025-03-04T03:24:38.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23652025-03-04T03:24:38.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23662025-03-04T03:24:38.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37408 req_id = 44cc9cb2-6065-45e9-b364-ff50aa70d4de response_code = 204 uri = /switch-ports
23672025-03-04T03:24:38.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55017
23682025-03-04T03:24:38.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55017 req_id = bcd8e499-bd31-40b7-a86b-9c7f9fbe8a04 response_code = 200 uri = /v2p
23692025-03-04T03:24:38.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37408 req_id = 00be0a00-1456-4d1a-abe9-69d5f16a426c response_code = 200 uri = /network-bootstore-config
23702025-03-04T03:24:38.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37583
23712025-03-04T03:24:38.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37583 req_id = 0cdcd29e-e773-477e-a07b-5977ff943aee response_code = 200 uri = /vpc-routes
23722025-03-04T03:24:39.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23732025-03-04T03:24:39.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37583 req_id = eccb91b1-0cde-4e07-991e-38539c5512b7 response_code = 204 uri = /eip-gateways
23742025-03-04T03:24:39.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37583 req_id = 9f0ec8e6-51f6-4a4f-95e7-6a9bf7ff4bb8 response_code = 204 uri = /vpc-routes
23752025-03-04T03:24:39.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33309
23762025-03-04T03:24:39.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23772025-03-04T03:24:39.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23782025-03-04T03:24:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33309 req_id = 6f464115-1210-489f-91fb-41f50b505505 response_code = 204 uri = /switch-ports
23792025-03-04T03:24:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33309 req_id = 81827f64-de29-4099-9d8d-8e2c4664cc91 response_code = 200 uri = /network-bootstore-config
23802025-03-04T03:24:39.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35485
23812025-03-04T03:24:39.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35485 req_id = cba08db8-3ce0-4fc3-a36a-29b9e4fad235 response_code = 200 uri = /v2p
23822025-03-04T03:24:47.258ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23832025-03-04T03:24:47.258ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23842025-03-04T03:24:47.285ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1999, tv_nsec: 482080234 } time_to_next_cleanup = 599.99999523s
23852025-03-04T03:24:51.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48437
23862025-03-04T03:24:51.886ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48437 req_id = 933790bb-16f5-4b3d-8444-3529f8c2e41d response_code = 200 uri = /baseboard
23872025-03-04T03:25:01.543ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
23882025-03-04T03:25:02.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4820 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 3f1428ae-51d6-40d2-9c65-16d0f7efc946 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
23892025-03-04T03:25:07.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50072
23902025-03-04T03:25:07.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50072 req_id = db93dce2-2dbf-4628-8c44-c100bd558769 response_code = 200 uri = /vpc-routes
23912025-03-04T03:25:07.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
23922025-03-04T03:25:07.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50072 req_id = cc079289-0d35-4482-a49d-5ea2039e01f7 response_code = 204 uri = /eip-gateways
23932025-03-04T03:25:07.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37737
23942025-03-04T03:25:07.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37737 req_id = 76fe4848-331d-4f3c-8581-ec9e6a482dd4 response_code = 200 uri = /v2p
23952025-03-04T03:25:07.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50072 req_id = b1ec336a-d5d2-41cd-a3cd-d05373ac82a3 response_code = 204 uri = /vpc-routes
23962025-03-04T03:25:07.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44264
23972025-03-04T03:25:07.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
23982025-03-04T03:25:07.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
23992025-03-04T03:25:07.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44264 req_id = 617110b0-c0b9-4c00-bd5a-36cb6e575a99 response_code = 204 uri = /switch-ports
24002025-03-04T03:25:07.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44264 req_id = a8ce2d61-a4a4-4d8a-baa2-f0cb6659b769 response_code = 200 uri = /network-bootstore-config
24012025-03-04T03:25:08.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44423
24022025-03-04T03:25:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44423 req_id = cfff994b-e3b1-4d4b-b76c-9de42bc68beb response_code = 200 uri = /vpc-routes
24032025-03-04T03:25:08.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24042025-03-04T03:25:08.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44423 req_id = 74fc1bde-6054-4c98-a7ca-2719b51bf8d9 response_code = 204 uri = /eip-gateways
24052025-03-04T03:25:08.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44423 req_id = 0b8aab2d-b111-4b69-b841-23dadf66d23f response_code = 204 uri = /vpc-routes
24062025-03-04T03:25:09.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37616
24072025-03-04T03:25:09.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24082025-03-04T03:25:09.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24092025-03-04T03:25:09.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37616 req_id = 658c7205-b13d-4e09-b992-e88f64145ae1 response_code = 204 uri = /switch-ports
24102025-03-04T03:25:09.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38310
24112025-03-04T03:25:09.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38310 req_id = 4b366029-5ee7-414b-81e5-504515c1dbf5 response_code = 200 uri = /v2p
24122025-03-04T03:25:09.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37616 req_id = d9aeacd8-6aec-4bb2-b0c8-f8371aa458ec response_code = 200 uri = /network-bootstore-config
24132025-03-04T03:25:09.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41750
24142025-03-04T03:25:09.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41750 req_id = 2163d1f9-0ea6-416b-897b-2acbb47a234f response_code = 200 uri = /vpc-routes
24152025-03-04T03:25:09.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24162025-03-04T03:25:09.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41750 req_id = 1f9484f9-d386-4769-add0-1a2fbdcd42b2 response_code = 204 uri = /eip-gateways
24172025-03-04T03:25:09.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41750 req_id = de13e99c-feac-4cb9-b23c-9792bc1a316a response_code = 204 uri = /vpc-routes
24182025-03-04T03:25:09.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35721
24192025-03-04T03:25:09.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35721 req_id = fade5097-55ae-486f-b4f8-cb0c0bea7fdc response_code = 200 uri = /v2p
24202025-03-04T03:25:09.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35238
24212025-03-04T03:25:09.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24222025-03-04T03:25:09.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24232025-03-04T03:25:09.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35238 req_id = 3500916e-abeb-4670-8aa4-04b04668d46a response_code = 204 uri = /switch-ports
24242025-03-04T03:25:09.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35238 req_id = 28371ec1-a55c-453b-867e-e51370488796 response_code = 200 uri = /network-bootstore-config
24252025-03-04T03:25:21.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65168
24262025-03-04T03:25:21.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65168 req_id = ed1d568e-7838-4e96-a45e-6d51312aaa27 response_code = 200 uri = /baseboard
24272025-03-04T03:25:32.910ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7157 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 339b43f3-126b-4767-a11d-c56b8a9d1439 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
24282025-03-04T03:25:37.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51017
24292025-03-04T03:25:37.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51017 req_id = 84e505e9-8060-4155-8ccb-2b1473e1078e response_code = 200 uri = /vpc-routes
24302025-03-04T03:25:37.441ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24312025-03-04T03:25:37.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51017 req_id = 5e5aa58a-97dc-472a-be13-67b0b80cdc8c response_code = 204 uri = /eip-gateways
24322025-03-04T03:25:37.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51141
24332025-03-04T03:25:37.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51141 req_id = fa5c2e33-23a1-4ebe-94e3-63e3fa0c8b8c response_code = 200 uri = /v2p
24342025-03-04T03:25:37.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51017 req_id = 095a0915-09a9-4116-b341-76c58835bbdc response_code = 204 uri = /vpc-routes
24352025-03-04T03:25:37.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57350
24362025-03-04T03:25:37.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24372025-03-04T03:25:37.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24382025-03-04T03:25:37.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57350 req_id = 0836158e-705d-4205-8b93-82532ae911ff response_code = 204 uri = /switch-ports
24392025-03-04T03:25:37.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57350 req_id = 1ccd530b-6bdf-4243-8887-e3e9d03857db response_code = 200 uri = /network-bootstore-config
24402025-03-04T03:25:38.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33354
24412025-03-04T03:25:38.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33354 req_id = 4bc2e10b-a34e-4f3c-baf4-67cfe98a7850 response_code = 200 uri = /vpc-routes
24422025-03-04T03:25:38.791ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24432025-03-04T03:25:38.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33354 req_id = 842830db-68d6-4797-a6ce-99d32e3063f0 response_code = 204 uri = /eip-gateways
24442025-03-04T03:25:38.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50274
24452025-03-04T03:25:38.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50274 req_id = 09d3be92-c65f-4fb6-9f15-5bd9df4b84eb response_code = 200 uri = /v2p
24462025-03-04T03:25:38.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33354 req_id = 94e3ec2f-454b-4f94-8e08-832d22daadcc response_code = 204 uri = /vpc-routes
24472025-03-04T03:25:38.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55245
24482025-03-04T03:25:38.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24492025-03-04T03:25:38.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24502025-03-04T03:25:38.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96988 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55245 req_id = f0ba1830-0a53-421e-a34a-25cdcd1fc6c4 response_code = 204 uri = /switch-ports
24512025-03-04T03:25:38.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55245 req_id = e3a28f90-8964-4301-8355-36214cdc1035 response_code = 200 uri = /network-bootstore-config
24522025-03-04T03:25:38.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52779
24532025-03-04T03:25:38.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52779 req_id = d99f17db-d592-44d2-a843-2977793ced0e response_code = 200 uri = /vpc-routes
24542025-03-04T03:25:39.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24552025-03-04T03:25:39.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52779 req_id = 55c855eb-ef65-4f73-9d5c-bf7fa1226ad2 response_code = 204 uri = /eip-gateways
24562025-03-04T03:25:39.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52779 req_id = 66384235-5c1e-4736-9697-45496d0e1ba9 response_code = 204 uri = /vpc-routes
24572025-03-04T03:25:39.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44916
24582025-03-04T03:25:39.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44916 req_id = 798c1476-b9d5-47b6-a9eb-9b9b20172138 response_code = 200 uri = /v2p
24592025-03-04T03:25:39.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45232
24602025-03-04T03:25:39.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24612025-03-04T03:25:39.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24622025-03-04T03:25:39.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45232 req_id = 93100f7a-ae11-44b6-92d7-8f00e7819646 response_code = 204 uri = /switch-ports
24632025-03-04T03:25:39.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45232 req_id = 8734286d-f27c-40aa-aeca-a6d00d9999f9 response_code = 200 uri = /network-bootstore-config
24642025-03-04T03:25:51.956ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54003
24652025-03-04T03:25:51.956ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54003 req_id = 183a8fb8-07f1-4ba3-bace-a26895e20185 response_code = 200 uri = /baseboard
24662025-03-04T03:26:02.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4948 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = e0d25dd7-06ce-4a6f-b17f-dde8385f49a7 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
24672025-03-04T03:26:07.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45436
24682025-03-04T03:26:07.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45436 req_id = fcecd82d-5cf6-4bcc-89ef-cb5cf1cd3cbb response_code = 200 uri = /vpc-routes
24692025-03-04T03:26:07.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24702025-03-04T03:26:07.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45436 req_id = 3551c9fd-bc47-4b04-8e6c-e9336ee53747 response_code = 204 uri = /eip-gateways
24712025-03-04T03:26:07.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45436 req_id = c663fe82-a04a-4d4f-828c-d0e5b70fea07 response_code = 204 uri = /vpc-routes
24722025-03-04T03:26:07.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47593
24732025-03-04T03:26:07.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47593 req_id = 56230be4-3a20-435c-b80e-17aaae831551 response_code = 200 uri = /v2p
24742025-03-04T03:26:07.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55955
24752025-03-04T03:26:07.669ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24762025-03-04T03:26:07.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24772025-03-04T03:26:07.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55955 req_id = aede83da-9d32-4b6a-8fb6-5efbc3be3ecb response_code = 204 uri = /switch-ports
24782025-03-04T03:26:07.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55955 req_id = 1d0bac55-302c-4366-b018-52abd2ebf9fd response_code = 200 uri = /network-bootstore-config
24792025-03-04T03:26:08.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37188
24802025-03-04T03:26:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37188 req_id = 974da97e-dc00-480c-bbf9-7cd9f2680b00 response_code = 200 uri = /vpc-routes
24812025-03-04T03:26:08.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47741
24822025-03-04T03:26:08.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47741 req_id = ca2b2f3d-a8ad-4c0c-a415-8b077050cf26 response_code = 200 uri = /v2p
24832025-03-04T03:26:08.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24842025-03-04T03:26:08.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37188 req_id = 1e0cb99b-78dc-4ded-a304-0314ab44c868 response_code = 204 uri = /eip-gateways
24852025-03-04T03:26:08.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37188 req_id = 15fc1857-afe6-4feb-8d6b-c5c9eca3b9ae response_code = 204 uri = /vpc-routes
24862025-03-04T03:26:09.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52877
24872025-03-04T03:26:09.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
24882025-03-04T03:26:09.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
24892025-03-04T03:26:09.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52877 req_id = 4fe7bde5-1d19-4dc1-be94-77ef0c05e3b9 response_code = 204 uri = /switch-ports
24902025-03-04T03:26:09.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52877 req_id = 6c10fe19-4386-4580-ae46-019e68d87b37 response_code = 200 uri = /network-bootstore-config
24912025-03-04T03:26:09.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33030
24922025-03-04T03:26:09.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33030 req_id = a6dc4caa-a4af-4989-99b8-04ecaad04121 response_code = 200 uri = /vpc-routes
24932025-03-04T03:26:09.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65230
24942025-03-04T03:26:09.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65230 req_id = ec462b42-0d0d-4223-a6cd-66abc1247b38 response_code = 200 uri = /v2p
24952025-03-04T03:26:09.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
24962025-03-04T03:26:09.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33030 req_id = ed8e4bb4-847a-494c-8a5b-f936716a7832 response_code = 204 uri = /eip-gateways
24972025-03-04T03:26:09.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33030 req_id = adfa0e81-05e6-4ed7-9cc5-23b2afc64a1e response_code = 204 uri = /vpc-routes
24982025-03-04T03:26:09.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38148
24992025-03-04T03:26:09.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25002025-03-04T03:26:09.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25012025-03-04T03:26:09.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38148 req_id = bd453ad5-5eb9-4ef5-9979-13ae3f8bbf14 response_code = 204 uri = /switch-ports
25022025-03-04T03:26:09.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38148 req_id = 4186dc84-a681-4f87-a0fc-fee4e6a8e079 response_code = 200 uri = /network-bootstore-config
25032025-03-04T03:26:21.991ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35161
25042025-03-04T03:26:21.991ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35161 req_id = f64eb079-d73f-4ddd-a48d-b13c8cba6438 response_code = 200 uri = /baseboard
25052025-03-04T03:26:32.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5483 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = b346cacc-57b7-4379-a2c1-afc3681693ff response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
25062025-03-04T03:26:37.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53445
25072025-03-04T03:26:37.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53445 req_id = f8c4af56-d170-49fa-ab39-0c2f37bbc47f response_code = 200 uri = /vpc-routes
25082025-03-04T03:26:37.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25092025-03-04T03:26:37.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53445 req_id = a10033ec-4fec-4056-abdb-2e603a98e1e9 response_code = 204 uri = /eip-gateways
25102025-03-04T03:26:37.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53445 req_id = 653cd284-dc3e-42db-a9c7-ff64410835af response_code = 204 uri = /vpc-routes
25112025-03-04T03:26:37.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45485
25122025-03-04T03:26:37.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45485 req_id = 12fc0776-6422-403b-9e86-13234585b32b response_code = 200 uri = /v2p
25132025-03-04T03:26:37.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52260
25142025-03-04T03:26:37.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25152025-03-04T03:26:37.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25162025-03-04T03:26:37.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52260 req_id = 47e3392d-d6bf-4fb6-90ff-59651753540c response_code = 204 uri = /switch-ports
25172025-03-04T03:26:37.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52260 req_id = 76677708-6b40-444f-80ba-6de979bd6f6a response_code = 200 uri = /network-bootstore-config
25182025-03-04T03:26:38.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45855
25192025-03-04T03:26:38.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45855 req_id = ec6ae5e1-fd19-4bec-8e0c-e46960f94232 response_code = 200 uri = /vpc-routes
25202025-03-04T03:26:38.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49900
25212025-03-04T03:26:38.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49900 req_id = 210444fe-0419-49d0-83c9-69189d467f09 response_code = 200 uri = /v2p
25222025-03-04T03:26:38.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25232025-03-04T03:26:38.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45855 req_id = 47d62e66-90d6-4fef-8472-67c6d8f1dba8 response_code = 204 uri = /eip-gateways
25242025-03-04T03:26:38.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45855 req_id = 71f36cf5-551f-4a28-ba18-1da66ce5f474 response_code = 204 uri = /vpc-routes
25252025-03-04T03:26:38.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38316
25262025-03-04T03:26:38.704ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25272025-03-04T03:26:38.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25282025-03-04T03:26:38.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38316 req_id = 4fcfb17c-b8c1-407c-a23a-c7d5bffbf027 response_code = 204 uri = /switch-ports
25292025-03-04T03:26:38.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38316 req_id = 4341e8e1-2255-487f-82fd-5fedabba2214 response_code = 200 uri = /network-bootstore-config
25302025-03-04T03:26:38.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60797
25312025-03-04T03:26:38.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60797 req_id = 8216644d-51f3-4bbe-ac8c-563a614d3e47 response_code = 200 uri = /vpc-routes
25322025-03-04T03:26:38.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25332025-03-04T03:26:38.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60797 req_id = 1d1de227-b550-40e1-b679-74160f291841 response_code = 204 uri = /eip-gateways
25342025-03-04T03:26:38.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60797 req_id = f6c66a91-85f9-42fc-81ac-53fc027221f4 response_code = 204 uri = /vpc-routes
25352025-03-04T03:26:39.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43135
25362025-03-04T03:26:39.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25372025-03-04T03:26:39.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25382025-03-04T03:26:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43135 req_id = c486d213-9420-45f4-bfb8-35cc10372d76 response_code = 204 uri = /switch-ports
25392025-03-04T03:26:39.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58024
25402025-03-04T03:26:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58024 req_id = 306a1514-aae5-42f4-8113-fd1b0d39541e response_code = 200 uri = /v2p
25412025-03-04T03:26:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43135 req_id = 8ac62bfd-18eb-4b90-b072-402a0418ef91 response_code = 200 uri = /network-bootstore-config
25422025-03-04T03:26:52.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37106
25432025-03-04T03:26:52.023ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37106 req_id = 7a503233-8fdd-44b3-849f-1c2b6efae02a response_code = 200 uri = /baseboard
25442025-03-04T03:27:02.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5743 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 3299da29-8ee5-4159-83e0-775b05a46072 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
25452025-03-04T03:27:07.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59108
25462025-03-04T03:27:07.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59108 req_id = f2802983-e58b-4a64-be9f-ad73942b6a7a response_code = 200 uri = /vpc-routes
25472025-03-04T03:27:07.546ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25482025-03-04T03:27:07.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59108 req_id = 4d2f450d-5255-44d0-bdbb-4534abe0dbf6 response_code = 204 uri = /eip-gateways
25492025-03-04T03:27:07.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55640
25502025-03-04T03:27:07.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55640 req_id = 067979e8-8115-42f5-a0aa-2363b153872a response_code = 200 uri = /v2p
25512025-03-04T03:27:07.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59108 req_id = 569de924-1b31-45f7-9f56-b3eea275eb57 response_code = 204 uri = /vpc-routes
25522025-03-04T03:27:07.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61902
25532025-03-04T03:27:07.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25542025-03-04T03:27:07.759ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25552025-03-04T03:27:07.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61902 req_id = 2af2fd19-5957-4833-bc75-d103f61b3d99 response_code = 204 uri = /switch-ports
25562025-03-04T03:27:07.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61902 req_id = 5564923f-b57b-4d33-a08b-40651ec4a63e response_code = 200 uri = /network-bootstore-config
25572025-03-04T03:27:08.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44928
25582025-03-04T03:27:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44928 req_id = af1f9623-579c-4434-b891-b45621ef7914 response_code = 200 uri = /vpc-routes
25592025-03-04T03:27:08.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25602025-03-04T03:27:08.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44928 req_id = 4cb6f3bb-e7a1-46a8-b7b7-0226b4ba8599 response_code = 204 uri = /eip-gateways
25612025-03-04T03:27:08.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56229
25622025-03-04T03:27:08.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56229 req_id = 35993b02-b364-4d88-9a77-c2dfb46b908d response_code = 200 uri = /v2p
25632025-03-04T03:27:08.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44928 req_id = a7710513-31dd-4d27-99ff-c307999bd3a4 response_code = 204 uri = /vpc-routes
25642025-03-04T03:27:08.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54496
25652025-03-04T03:27:08.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25662025-03-04T03:27:09.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25672025-03-04T03:27:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54496 req_id = 9504eed5-c395-487a-a2d0-70dfb89dbc74 response_code = 204 uri = /switch-ports
25682025-03-04T03:27:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54496 req_id = 98285ef1-102b-4168-acc0-ea5a6c2fcfe3 response_code = 200 uri = /network-bootstore-config
25692025-03-04T03:27:09.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40592
25702025-03-04T03:27:09.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40592 req_id = fbecef72-5fc7-4647-82ad-78d8a86aa2e0 response_code = 200 uri = /vpc-routes
25712025-03-04T03:27:09.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25722025-03-04T03:27:09.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40592 req_id = 8a9e7de3-d1a3-41ac-b066-d930260aeb6d response_code = 204 uri = /eip-gateways
25732025-03-04T03:27:09.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40592 req_id = 4df64bbe-7537-4a89-ad53-8b0d6b264dd7 response_code = 204 uri = /vpc-routes
25742025-03-04T03:27:09.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40669
25752025-03-04T03:27:09.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25762025-03-04T03:27:09.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25772025-03-04T03:27:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40669 req_id = 71cfc809-e435-4e2f-b55c-e0a41d286980 response_code = 204 uri = /switch-ports
25782025-03-04T03:27:09.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58908
25792025-03-04T03:27:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58908 req_id = ad23580d-71ab-46c3-8757-f2d4c67e76a6 response_code = 200 uri = /v2p
25802025-03-04T03:27:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40669 req_id = 29c7a774-6a83-4a0f-b997-25a2ad41164b response_code = 200 uri = /network-bootstore-config
25812025-03-04T03:27:22.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65010
25822025-03-04T03:27:22.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65010 req_id = 5c2aed26-cd0a-4622-9ff7-1a69a2aa9ca9 response_code = 200 uri = /baseboard
25832025-03-04T03:27:32.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4976 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 4fd377cc-dba8-4535-95a7-1a2010eebbfa response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
25842025-03-04T03:27:37.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49616
25852025-03-04T03:27:37.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49616 req_id = e8aa169d-f7aa-420c-8438-b0b04a51660f response_code = 200 uri = /vpc-routes
25862025-03-04T03:27:37.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25872025-03-04T03:27:37.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49616 req_id = 4acf2e76-17f3-4db0-bf74-b102193d208b response_code = 204 uri = /eip-gateways
25882025-03-04T03:27:37.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49616 req_id = 49f973bf-5bb7-4941-aa4c-627b33ba4772 response_code = 204 uri = /vpc-routes
25892025-03-04T03:27:37.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43769
25902025-03-04T03:27:37.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43769 req_id = 297dbdc2-d081-4605-8e5a-a20608f11a83 response_code = 200 uri = /v2p
25912025-03-04T03:27:37.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37405
25922025-03-04T03:27:37.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
25932025-03-04T03:27:37.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
25942025-03-04T03:27:37.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37405 req_id = ac0dd6a3-a8f0-40b4-8a44-feaa4f1b9109 response_code = 204 uri = /switch-ports
25952025-03-04T03:27:37.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37405 req_id = 3f85511c-3839-4375-bc06-522ac35b5e43 response_code = 200 uri = /network-bootstore-config
25962025-03-04T03:27:38.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47925
25972025-03-04T03:27:38.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47925 req_id = a83964ce-3126-4492-8b0f-2e54cbe60c7f response_code = 200 uri = /vpc-routes
25982025-03-04T03:27:38.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
25992025-03-04T03:27:38.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47925 req_id = 258f67e0-d119-4e63-aa82-3ed4bb56e90d response_code = 204 uri = /eip-gateways
26002025-03-04T03:27:38.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47925 req_id = 6e72eb5e-4306-4b1a-b847-dea00ebd2c26 response_code = 204 uri = /vpc-routes
26012025-03-04T03:27:38.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59422
26022025-03-04T03:27:38.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
26032025-03-04T03:27:38.905ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
26042025-03-04T03:27:38.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59422 req_id = 802ea1c8-8723-4622-92d8-0779f5966c19 response_code = 204 uri = /switch-ports
26052025-03-04T03:27:38.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42154
26062025-03-04T03:27:38.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42154 req_id = 84519837-ebb0-4da6-b1ce-b3ef87369e78 response_code = 200 uri = /v2p
26072025-03-04T03:27:38.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59422 req_id = 8d0194ca-c618-451d-a5ac-bff559a4d1b1 response_code = 200 uri = /network-bootstore-config
26082025-03-04T03:27:39.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53116
26092025-03-04T03:27:39.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53116 req_id = b84c5365-539f-4684-a3ea-1343994ff78a response_code = 200 uri = /vpc-routes
26102025-03-04T03:27:39.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
26112025-03-04T03:27:39.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53116 req_id = 89cac3dc-22d6-485f-bbbd-122c3613131d response_code = 204 uri = /eip-gateways
26122025-03-04T03:27:39.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46153
26132025-03-04T03:27:39.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46153 req_id = dec0acfd-6933-4aa0-8f5f-2baf804e894f response_code = 200 uri = /v2p
26142025-03-04T03:27:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53116 req_id = e92b537f-cf19-4463-be19-6d479272df69 response_code = 204 uri = /vpc-routes
26152025-03-04T03:27:39.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44002
26162025-03-04T03:27:39.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
26172025-03-04T03:27:39.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
26182025-03-04T03:27:39.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44002 req_id = 377ea292-b812-448f-a454-a91060407861 response_code = 204 uri = /switch-ports
26192025-03-04T03:27:39.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44002 req_id = 81dcf79a-a795-441e-82e7-f6af918f779b response_code = 200 uri = /network-bootstore-config
26202025-03-04T03:27:52.089ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54960
26212025-03-04T03:27:52.089ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54960 req_id = eb96a8a9-3587-4f20-b3cf-64d2e6c58a7c response_code = 200 uri = /baseboard
26222025-03-04T03:28:02.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5056 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = d9822450-72d3-43c1-b306-2c67c7bc4f51 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
26232025-03-04T03:28:07.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47977
26242025-03-04T03:28:07.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47977 req_id = ec836bdc-725a-4bc6-b158-79caffb714df response_code = 200 uri = /vpc-routes
26252025-03-04T03:28:07.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59827
26262025-03-04T03:28:07.864ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26272025-03-04T03:28:07.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59827 req_id = fa9a428d-9365-4763-bb6b-7735fd6ae379 response_code = 200 uri = /artifacts
26282025-03-04T03:28:07.897ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
26292025-03-04T03:28:07.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47977 req_id = c81dc3c6-6ba5-47a2-9ffa-82369059e03b response_code = 204 uri = /eip-gateways
26302025-03-04T03:28:07.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47977 req_id = 1d1a374c-5dcd-4255-a990-9cdccfc1fac0 response_code = 204 uri = /vpc-routes
26312025-03-04T03:28:08.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55753
26322025-03-04T03:28:08.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55753 req_id = 8159888c-5da6-40aa-b245-7d3cd7850ff3 response_code = 200 uri = /v2p
26332025-03-04T03:28:08.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35451
26342025-03-04T03:28:08.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26352025-03-04T03:28:08.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26362025-03-04T03:28:08.121ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
26372025-03-04T03:28:08.121ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
26382025-03-04T03:28:08.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26392025-03-04T03:28:08.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3
26402025-03-04T03:28:08.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49604
26412025-03-04T03:28:08.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
26422025-03-04T03:28:08.160ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26432025-03-04T03:28:08.160ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8bf53b00-dedd-4516-be68-25e52e3985f5
26442025-03-04T03:28:08.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
26452025-03-04T03:28:08.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26462025-03-04T03:28:08.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725
26472025-03-04T03:28:08.208ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482025-03-04T03:28:08.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_92e4d589-1042-4d5f-a963-b670e19540f9
26492025-03-04T03:28:08.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26502025-03-04T03:28:08.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40
26512025-03-04T03:28:08.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49604 req_id = 396295f4-9363-419b-8aeb-a1121d5408ab response_code = 204 uri = /switch-ports
26522025-03-04T03:28:08.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49604 req_id = acdc39d9-57a1-4cbd-9269-47ba49e948cd response_code = 200 uri = /network-bootstore-config
26532025-03-04T03:28:08.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26542025-03-04T03:28:08.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_ce1d8eb5-4250-40ee-a991-35c54c086636
26552025-03-04T03:28:08.282ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26562025-03-04T03:28:08.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26
26572025-03-04T03:28:08.304ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582025-03-04T03:28:08.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797
26592025-03-04T03:28:08.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-03-04T03:28:08.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf
26612025-03-04T03:28:08.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35451 req_id = 776cd427-690f-4b4a-9c3a-4f2b8ba4111d response_code = 200 uri = /inventory
26622025-03-04T03:28:08.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34615
26632025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26642025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26652025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26662025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26672025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26682025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26692025-03-04T03:28:08.431ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26702025-03-04T03:28:08.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34615 req_id = aacc534b-e5b3-4e25-8777-adc0efda3fbc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26712025-03-04T03:28:09.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41111
26722025-03-04T03:28:09.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41111 req_id = 89155429-833b-4b17-bd63-958760b4438e response_code = 200 uri = /vpc-routes
26732025-03-04T03:28:09.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58389
26742025-03-04T03:28:09.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58389 req_id = b0dbcb8f-131e-43d0-874a-e98f513df479 response_code = 200 uri = /v2p
26752025-03-04T03:28:09.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62463
26762025-03-04T03:28:09.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26772025-03-04T03:28:09.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62463 req_id = 3ff2c37d-e841-479a-a5da-afac78cb1987 response_code = 200 uri = /artifacts
26782025-03-04T03:28:09.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
26792025-03-04T03:28:09.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41111 req_id = 0a7a6f1a-be65-4b34-ab78-824b18a742f4 response_code = 204 uri = /eip-gateways
26802025-03-04T03:28:09.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41111 req_id = 74b32527-959f-42c5-bd6d-0ebd0d75eba8 response_code = 204 uri = /vpc-routes
26812025-03-04T03:28:09.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34067
26822025-03-04T03:28:09.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
26832025-03-04T03:28:09.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
26842025-03-04T03:28:09.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104070 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34067 req_id = 91b48eb5-f8db-4d53-a38f-a559b3560190 response_code = 204 uri = /switch-ports
26852025-03-04T03:28:09.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34993
26862025-03-04T03:28:09.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60257
26872025-03-04T03:28:09.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56255
26882025-03-04T03:28:09.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46462
26892025-03-04T03:28:09.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34067 req_id = 8f8138c8-628d-4468-b871-813e3a9243e5 response_code = 200 uri = /network-bootstore-config
26902025-03-04T03:28:09.252ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26912025-03-04T03:28:09.252ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26922025-03-04T03:28:09.252ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26932025-03-04T03:28:09.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56255 req_id = 799da548-173e-4b00-8932-f090cc33f601 response_code = 200 uri = /v2p
26942025-03-04T03:28:09.252ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
26952025-03-04T03:28:09.252ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
26962025-03-04T03:28:09.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46462 req_id = 63926684-6e7f-4fb5-bae6-76f404abb5f4 response_code = 200 uri = /artifacts
26972025-03-04T03:28:09.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60257 req_id = 3cee6723-9032-4371-9757-275ccc5d4f00 response_code = 200 uri = /vpc-routes
26982025-03-04T03:28:09.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-03-04T03:28:09.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3
27002025-03-04T03:28:09.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
27012025-03-04T03:28:09.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 628 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60257 req_id = 71de411e-7836-4054-9250-6c7e1eb530fc response_code = 204 uri = /eip-gateways
27022025-03-04T03:28:09.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032025-03-04T03:28:09.292ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8bf53b00-dedd-4516-be68-25e52e3985f5
27042025-03-04T03:28:09.315ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052025-03-04T03:28:09.315ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725
27062025-03-04T03:28:09.338ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072025-03-04T03:28:09.338ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_92e4d589-1042-4d5f-a963-b670e19540f9
27082025-03-04T03:28:09.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62756
27092025-03-04T03:28:09.350ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27102025-03-04T03:28:09.350ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27112025-03-04T03:28:09.350ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/config/omicron-zones.json file = common/src/ledger.rs:175
27122025-03-04T03:28:09.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 983 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60257 req_id = bd234f73-7e5a-49bb-b06a-c904f9501bbf response_code = 204 uri = /vpc-routes
27132025-03-04T03:28:09.354ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/config/omicron-zones.json file = common/src/ledger.rs:175
27142025-03-04T03:28:09.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-03-04T03:28:09.361ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40
27162025-03-04T03:28:09.376ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a3bff479-6244-4b08-9d6f-2e2500192bf3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172025-03-04T03:28:09.376ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a3bff479-6244-4b08-9d6f-2e2500192bf3
27182025-03-04T03:28:09.402ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8bf53b00-dedd-4516-be68-25e52e3985f5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27192025-03-04T03:28:09.402ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8bf53b00-dedd-4516-be68-25e52e3985f5
27202025-03-04T03:28:09.414ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27212025-03-04T03:28:09.414ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_ce1d8eb5-4250-40ee-a991-35c54c086636
27222025-03-04T03:28:09.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85937d80-6b2b-4d77-a850-1d11f4fc3725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27232025-03-04T03:28:09.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_85937d80-6b2b-4d77-a850-1d11f4fc3725
27242025-03-04T03:28:09.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37479
27252025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27262025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27272025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27282025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27292025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27302025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27312025-03-04T03:28:09.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27322025-03-04T03:28:09.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 662 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37479 req_id = 52ef7de4-d96d-457e-9240-8f0adec391e4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27332025-03-04T03:28:09.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37520
27342025-03-04T03:28:09.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
27352025-03-04T03:28:09.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27362025-03-04T03:28:09.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26
27372025-03-04T03:28:09.472ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27382025-03-04T03:28:09.472ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797
27392025-03-04T03:28:09.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
27402025-03-04T03:28:09.487ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92e4d589-1042-4d5f-a963-b670e19540f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412025-03-04T03:28:09.487ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_92e4d589-1042-4d5f-a963-b670e19540f9
27422025-03-04T03:28:09.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46576
27432025-03-04T03:28:09.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27442025-03-04T03:28:09.503ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf
27452025-03-04T03:28:09.511ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1efc0800-e2a1-43fb-8159-014fa2b2d648, kind: Service { id: 72700cb3-c938-46f0-9b9c-46cf389d975e }, name: Name("external-dns-72700cb3-c938-46f0-9b9c-46cf389d975e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 246])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6aab6111-ac14-4d7e-808e-18a2dbaec1a3, kind: Service { id: 0e2dad65-6466-48b5-bc3a-8a9f5178c9b7 }, name: Name("external-dns-0e2dad65-6466-48b5-bc3a-8a9f5178c9b7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 8])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05a86b80-7d75-4c2d-8253-0cdbdce17c69, kind: Service { id: 2afd3cd1-228b-4949-95e6-cb3413cc5ec2 }, name: Name("nexus-2afd3cd1-228b-4949-95e6-cb3413cc5ec2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3ce82d4d-d64c-418d-9d43-fc9e659efafa, kind: Service { id: c28b34ab-1b39-4325-87ad-c4ccf5b009d5 }, name: Name("nexus-c28b34ab-1b39-4325-87ad-c4ccf5b009d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 509b968a-6934-4b81-be1c-676fe22e2948, kind: Service { id: d8484452-7d43-42ac-a588-575b6d31b882 }, name: Name("nexus-d8484452-7d43-42ac-a588-575b6d31b882"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27462025-03-04T03:28:09.511ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27472025-03-04T03:28:09.511ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27482025-03-04T03:28:09.511ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27492025-03-04T03:28:09.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27502025-03-04T03:28:09.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27512025-03-04T03:28:09.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27522025-03-04T03:28:09.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46576 req_id = 9adac3ae-e636-4438-a838-0ea00fe5da2b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27532025-03-04T03:28:09.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5fc2c97d-a3e5-4273-98a3-7dcd202c0a40 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27542025-03-04T03:28:09.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5fc2c97d-a3e5-4273-98a3-7dcd202c0a40
27552025-03-04T03:28:09.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34993 req_id = 3d559436-f784-46ea-a9a0-1fb2784cacc2 response_code = 200 uri = /inventory
27562025-03-04T03:28:09.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ce1d8eb5-4250-40ee-a991-35c54c086636 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27572025-03-04T03:28:09.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_ce1d8eb5-4250-40ee-a991-35c54c086636
27582025-03-04T03:28:09.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103191 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37520 req_id = 9f9ee7f7-c360-4292-989a-c1050aa4f86b response_code = 204 uri = /switch-ports
27592025-03-04T03:28:09.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37520 req_id = 4e7b4a92-3e17-4577-9c32-30130ae54f21 response_code = 200 uri = /network-bootstore-config
27602025-03-04T03:28:09.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c4184e0-2976-440b-bd79-f20b4a02ca26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27612025-03-04T03:28:09.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c4184e0-2976-440b-bd79-f20b4a02ca26
27622025-03-04T03:28:09.587ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5de7da7b-342c-4de4-8411-30cb9d4ca797 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27632025-03-04T03:28:09.587ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_5de7da7b-342c-4de4-8411-30cb9d4ca797
27642025-03-04T03:28:09.609ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27652025-03-04T03:28:09.609ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf
27662025-03-04T03:28:09.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62756 req_id = 15c1c3f4-1b89-457c-ad9c-a35143280e4c response_code = 200 uri = /inventory
27672025-03-04T03:28:22.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46097
27682025-03-04T03:28:22.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46097 req_id = 768e92e4-24dc-47c2-bb05-8f5d48770399 response_code = 200 uri = /baseboard
27692025-03-04T03:28:32.911ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7825 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 566168c8-9136-48d9-bc95-4b7d1f1f5786 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
27702025-03-04T03:28:37.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53276
27712025-03-04T03:28:37.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53276 req_id = 84c86da4-1d91-41b2-addd-6af752115aaa response_code = 200 uri = /vpc-routes
27722025-03-04T03:28:37.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
27732025-03-04T03:28:37.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53276 req_id = e47d92f6-1c55-48fc-9a5c-a1656e17e8b9 response_code = 204 uri = /eip-gateways
27742025-03-04T03:28:37.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53276 req_id = 527891bd-cc62-4ff6-aa02-9f51623a87f9 response_code = 204 uri = /vpc-routes
27752025-03-04T03:28:37.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44721
27762025-03-04T03:28:37.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
27772025-03-04T03:28:37.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
27782025-03-04T03:28:37.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44721 req_id = b3339e0f-6b69-42b7-8a0c-7bfa1a361dd5 response_code = 204 uri = /switch-ports
27792025-03-04T03:28:37.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44721 req_id = a5b6baa8-dadd-492b-9954-3fca006657e2 response_code = 200 uri = /network-bootstore-config
27802025-03-04T03:28:37.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43663
27812025-03-04T03:28:37.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43663 req_id = 1f9bd7cb-72b9-412f-9086-9b1802b7f69d response_code = 200 uri = /v2p
27822025-03-04T03:28:38.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58690
27832025-03-04T03:28:38.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58690 req_id = 4fd3e6a4-8daa-4816-8f33-555c76ce3969 response_code = 200 uri = /vpc-routes
27842025-03-04T03:28:38.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
27852025-03-04T03:28:38.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58690 req_id = 7518688f-3943-4091-bb44-00dc5259f53c response_code = 204 uri = /eip-gateways
27862025-03-04T03:28:38.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58690 req_id = 2a80bc4e-2c5e-47eb-9028-730c16e0774e response_code = 204 uri = /vpc-routes
27872025-03-04T03:28:38.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34158
27882025-03-04T03:28:38.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34158 req_id = 383c63ca-1640-4a1c-a6ba-7dccdf1cb450 response_code = 200 uri = /v2p
27892025-03-04T03:28:38.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36230
27902025-03-04T03:28:38.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
27912025-03-04T03:28:38.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
27922025-03-04T03:28:38.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36230 req_id = db6af8af-9f5f-4b24-bacb-80825ca2328c response_code = 204 uri = /switch-ports
27932025-03-04T03:28:38.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36230 req_id = f59cf6d4-b633-4d5b-946b-927a0869361f response_code = 200 uri = /network-bootstore-config
27942025-03-04T03:28:38.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60313
27952025-03-04T03:28:38.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60313 req_id = 3a83deca-64f1-453a-9261-36e3e0c4a65b response_code = 200 uri = /vpc-routes
27962025-03-04T03:28:38.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
27972025-03-04T03:28:38.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60313 req_id = 6eaa9e81-85f6-407b-aba7-4606a60505ca response_code = 204 uri = /eip-gateways
27982025-03-04T03:28:39.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60313 req_id = 25103d32-764a-45be-92a4-819c05941c7c response_code = 204 uri = /vpc-routes
27992025-03-04T03:28:39.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58518
28002025-03-04T03:28:39.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58518 req_id = 04e6d755-e115-4deb-8e1b-6db1c64dbe0d response_code = 200 uri = /v2p
28012025-03-04T03:28:39.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51679
28022025-03-04T03:28:39.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
28032025-03-04T03:28:39.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
28042025-03-04T03:28:39.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51679 req_id = 8f918344-cdd8-4f2b-9f4a-833ff1f7b7e1 response_code = 204 uri = /switch-ports
28052025-03-04T03:28:39.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51679 req_id = 2a0eb0d6-90fd-4637-955f-ffdeba041660 response_code = 200 uri = /network-bootstore-config
28062025-03-04T03:28:52.160ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55943
28072025-03-04T03:28:52.160ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55943 req_id = e98617af-120a-44c6-8e29-fddf58d3bc27 response_code = 200 uri = /baseboard
28082025-03-04T03:29:02.910ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6384 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 795c02e2-8adc-4227-86b7-221285311807 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
28092025-03-04T03:29:07.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38617
28102025-03-04T03:29:07.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38617 req_id = dafcc191-544f-4713-9be3-10318aa36013 response_code = 200 uri = /vpc-routes
28112025-03-04T03:29:07.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
28122025-03-04T03:29:07.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38617 req_id = ff2ad9a0-13f5-4f45-89d6-f5b2e1b797bf response_code = 204 uri = /eip-gateways
28132025-03-04T03:29:07.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38617 req_id = 40626235-1fca-452e-a67b-a98e1f3c079d response_code = 204 uri = /vpc-routes
28142025-03-04T03:29:07.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37191
28152025-03-04T03:29:07.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37191 req_id = b25bd91c-270e-4515-abfe-ca7bcdecdac1 response_code = 200 uri = /v2p
28162025-03-04T03:29:07.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58516
28172025-03-04T03:29:07.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
28182025-03-04T03:29:08.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
28192025-03-04T03:29:08.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58516 req_id = ce680414-a359-4d4f-ad56-41e8ba6ece66 response_code = 204 uri = /switch-ports
28202025-03-04T03:29:08.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58516 req_id = 13597726-f1ca-472b-aaba-2a4a9acc4e8d response_code = 200 uri = /network-bootstore-config
28212025-03-04T03:29:08.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37896
28222025-03-04T03:29:08.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37896 req_id = 0350fb82-ff75-4eb5-9fad-65855cdf980b response_code = 200 uri = /vpc-routes
28232025-03-04T03:29:08.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
28242025-03-04T03:29:08.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37896 req_id = 226bf920-3efb-4218-8a15-da237ef01ab5 response_code = 204 uri = /eip-gateways
28252025-03-04T03:29:08.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37896 req_id = 6f4eccc7-c22f-4cbc-8e8e-e7984c16d247 response_code = 204 uri = /vpc-routes
28262025-03-04T03:29:08.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47918
28272025-03-04T03:29:08.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47918 req_id = 8797fb49-6397-49b3-8253-0783917149c4 response_code = 200 uri = /v2p
28282025-03-04T03:29:08.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54033
28292025-03-04T03:29:08.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
28302025-03-04T03:29:08.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
28312025-03-04T03:29:09.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54033 req_id = 4da03568-6fb7-47c0-9c52-149e8067fa56 response_code = 204 uri = /switch-ports
28322025-03-04T03:29:09.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54033 req_id = 865c7c9e-66b5-445b-91e9-d2302b8d02ab response_code = 200 uri = /network-bootstore-config
28332025-03-04T03:29:09.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59638
28342025-03-04T03:29:09.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59638 req_id = 838f003e-8945-41b7-8064-90fec686dec7 response_code = 200 uri = /vpc-routes
28352025-03-04T03:29:09.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
28362025-03-04T03:29:09.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59638 req_id = bb38a138-4df4-4dbf-8f1f-a0ceb24f759c response_code = 204 uri = /eip-gateways
28372025-03-04T03:29:09.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59638 req_id = a7821044-2d55-4c53-ae4f-61f6d2f1bc94 response_code = 204 uri = /vpc-routes
28382025-03-04T03:29:09.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46543
28392025-03-04T03:29:09.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
28402025-03-04T03:29:09.380ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
28412025-03-04T03:29:09.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46543 req_id = fb924857-7112-4d68-8ad0-f725d098733c response_code = 204 uri = /switch-ports
28422025-03-04T03:29:09.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49658
28432025-03-04T03:29:09.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49658 req_id = d2aee136-85a1-4981-b600-52348dd5190c response_code = 200 uri = /v2p
28442025-03-04T03:29:09.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46543 req_id = a9871ad1-c569-45c2-a6e9-a5a4e5cb4187 response_code = 200 uri = /network-bootstore-config
28452025-03-04T03:29:12.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45371
28462025-03-04T03:29:12.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45371 req_id = 17094223-7105-405e-9e59-59505340305b response_code = 200 uri = /v2p
28472025-03-04T03:29:12.527ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10190244) }
28482025-03-04T03:29:12.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45371 req_id = dd09d0d1-7f87-4de3-ae1b-92e9d2d8b15f response_code = 204 uri = /v2p
28492025-03-04T03:29:12.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33515
28502025-03-04T03:29:12.636ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10190244))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e7f8ed91-6720-4ac8-b41d-e683d78e7363, slot: 0, read_only: false, vcr_json: .., name: "disk-77f2aa33306" }], boot_settings: Some(InstanceBootSettings { order: [e7f8ed91-6720-4ac8-b41d-e683d78e7363] }), cloud_init_bytes: Some(..) } instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece metadata = InstanceMetadata { silo_id: 99ae007e-ba78-4e30-b5ae-c2c9f3ed8d8b, project_id: 4aae3d30-75c8-4494-9282-778ebfbc0bf0 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-04T03:29:12.632093514Z }
28512025-03-04T03:29:12.636ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece migration_id = None propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28522025-03-04T03:29:12.637ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece migration_id = None propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10190244))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 77736455-ed72-486f-ba51-f777183a49b1, kind: Instance { id: 6386f39a-ec86-4b2a-bedb-170280f0cece }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10190244), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e7f8ed91-6720-4ac8-b41d-e683d78e7363, slot: 0, read_only: false, vcr_json: .., name: "disk-77f2aa33306" }], boot_settings: Some(InstanceBootSettings { order: [e7f8ed91-6720-4ac8-b41d-e683d78e7363] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-04T03:29:12.632093514Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28532025-03-04T03:29:12.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33515 req_id = b127dd72-4adf-4ba0-9483-ca084e3e130c response_code = 200 uri = /vmms/2b9e4940-ad8f-4164-81a6-9fc95270b38e
28542025-03-04T03:29:12.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60227
28552025-03-04T03:29:12.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60227 req_id = 7716cfa7-3e36-45bc-af50-4b468890e952 response_code = 200 uri = /vmms/2b9e4940-ad8f-4164-81a6-9fc95270b38e/state
28562025-03-04T03:29:12.745ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10190244 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28572025-03-04T03:29:12.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28582025-03-04T03:29:12.783ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e file = illumos-utils/src/zone.rs:327 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28592025-03-04T03:29:12.807ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e file = illumos-utils/src/zone.rs:365 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28602025-03-04T03:29:12.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54246
28612025-03-04T03:29:12.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54246 req_id = a92e411b-89c9-4f11-9611-33f2be218a5f response_code = 200 uri = /vpc-routes
28622025-03-04T03:29:12.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {77736455-ed72-486f-ba51-f777183a49b1: {10.151.2.176: {38c86375-c330-4b97-a512-a88012ce3a75}, 10.151.2.175: {38c86375-c330-4b97-a512-a88012ce3a75}}} }
28632025-03-04T03:29:14.198ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28642025-03-04T03:29:14.198ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e zone file = illumos-utils/src/running_zone.rs:491 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28652025-03-04T03:29:14.415ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 71.190556ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28662025-03-04T03:29:14.506ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 97.459584ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28672025-03-04T03:29:14.619ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 123.398998ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28682025-03-04T03:29:14.755ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 220.942141ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28692025-03-04T03:29:14.987ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 1.102573577s file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28702025-03-04T03:29:16.102ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 1.116791273s file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28712025-03-04T03:29:17.230ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 964.925194ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28722025-03-04T03:29:18.205ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 717.191135ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28732025-03-04T03:29:18.934ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e") failed: Property not found. retry in 895.224851ms file = illumos-utils/src/svc.rs:42 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e zone = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
28742025-03-04T03:29:19.861ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e file = sled-agent/src/instance.rs:2133 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28752025-03-04T03:29:19.870ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28762025-03-04T03:29:19.908ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28772025-03-04T03:29:19.990ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28782025-03-04T03:29:19.991ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
28792025-03-04T03:29:19.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7154588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54246 req_id = 5b98c602-9f3e-4653-8605-49575c508540 response_code = 204 uri = /eip-gateways
28802025-03-04T03:29:19.992ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-04T03:29:19.992329668Z } file = sled-agent/src/instance.rs:842 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28812025-03-04T03:29:19.992ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-04T03:29:19.992329668Z } propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28822025-03-04T03:29:19.992ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-04T03:29:19.992329668Z }, migration_in: None, migration_out: None }
28832025-03-04T03:29:20.070ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-04T03:29:20.070247803Z } file = sled-agent/src/instance.rs:842 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28842025-03-04T03:29:20.070ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-04T03:29:20.070247803Z } propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28852025-03-04T03:29:20.070ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-04T03:29:20.070247803Z }, migration_in: None, migration_out: None }
28862025-03-04T03:29:20.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54246 req_id = 9feb3f46-1f7b-4c54-b149-f3ce63a355a0 response_code = 204 uri = /vpc-routes
28872025-03-04T03:29:22.193ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64951
28882025-03-04T03:29:22.193ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64951 req_id = 704e4372-9c57-45f5-b97f-eeba33948a0c response_code = 200 uri = /baseboard
28892025-03-04T03:29:30.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43004
28902025-03-04T03:29:30.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43004 req_id = a7cb5328-cb92-40bf-bc24-0a26d9f7651d response_code = 200 uri = /vmms/2b9e4940-ad8f-4164-81a6-9fc95270b38e/state
28912025-03-04T03:29:30.330ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-04T03:29:30.330144886Z } file = sled-agent/src/instance.rs:842 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28922025-03-04T03:29:30.330ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-04T03:29:30.330144886Z } propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28932025-03-04T03:29:30.330ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-04T03:29:30.330144886Z }, migration_in: None, migration_out: None }
28942025-03-04T03:29:30.370ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-04T03:29:30.370282327Z } file = sled-agent/src/instance.rs:842 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28952025-03-04T03:29:30.370ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-04T03:29:30.370282327Z } propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28962025-03-04T03:29:30.370ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
28972025-03-04T03:29:30.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28982025-03-04T03:29:30.371ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11885313119038783304 n_samples = 6 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
28992025-03-04T03:29:30.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29002025-03-04T03:29:30.371ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8581892637729783098 n_samples = 6 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
29012025-03-04T03:29:30.372ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/b4fa6708-6730-444b-8f50-72671c4329fe/debug/bundle/zone", "/pool/int/bf355b46-ea11-4cbf-a29a-2777749d4c54/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/a3bff479-6244-4b08-9d6f-2e2500192bf3/crypt/debug", "/pool/ext/8bf53b00-dedd-4516-be68-25e52e3985f5/crypt/debug", "/pool/ext/85937d80-6b2b-4d77-a850-1d11f4fc3725/crypt/debug", "/pool/ext/92e4d589-1042-4d5f-a963-b670e19540f9/crypt/debug", "/pool/ext/5fc2c97d-a3e5-4273-98a3-7dcd202c0a40/crypt/debug", "/pool/ext/ce1d8eb5-4250-40ee-a991-35c54c086636/crypt/debug", "/pool/ext/0c4184e0-2976-440b-bd79-f20b4a02ca26/crypt/debug", "/pool/ext/5de7da7b-342c-4de4-8411-30cb9d4ca797/crypt/debug", "/pool/ext/d7d54ab9-7a5a-4ab8-affd-e19e0eeeffdf/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e
29022025-03-04T03:29:31.008ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1144 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e", bundle_id: e20bafcf-37bd-48b4-8074-9acb6ab5bf12 }, time_created: 2025-03-04T03:29:30.373123892Z, version: 0, cause: TerminatedInstance }
29032025-03-04T03:29:31.008ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_2b9e4940-ad8f-4164-81a6-9fc95270b38e file = sled-agent/src/instance.rs:1376 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
29042025-03-04T03:29:32.751ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:281 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
29052025-03-04T03:29:32.767ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(10190244), kind: System }
29062025-03-04T03:29:32.767ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(10190244), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29072025-03-04T03:29:32.767ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-04T03:29:32.767651148Z }, migration_in: None, migration_out: None }
29082025-03-04T03:29:32.834ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-04T03:29:32.767651148Z }, migration_in: None, migration_out: None }
29092025-03-04T03:29:32.838ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 6386f39a-ec86-4b2a-bedb-170280f0cece propolis_id = 2b9e4940-ad8f-4164-81a6-9fc95270b38e
29102025-03-04T03:29:32.910ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5510 local_addr = [fd00:1122:3344:101::1]:32804 method = GET remote_addr = [fd00:1122:3344:101::d]:64303 req_id = 96f159bd-3ca4-4424-a76e-4b5aac3dabc1 response_code = 200 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c uri = /5525e426-7299-43ab-ad2b-346968b24e1c
29112025-03-04T03:29:33.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65226
29122025-03-04T03:29:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65226 req_id = 3db01e80-f384-4b6e-a0df-5244500a54d1 response_code = 200 uri = /vpc-routes
29132025-03-04T03:29:33.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {77736455-ed72-486f-ba51-f777183a49b1: {10.151.2.176: {38c86375-c330-4b97-a512-a88012ce3a75}, 10.151.2.175: {38c86375-c330-4b97-a512-a88012ce3a75}}} }
29142025-03-04T03:29:33.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65226 req_id = f9acca7c-30b3-4dfa-9215-78352c4edb5f response_code = 204 uri = /eip-gateways
29152025-03-04T03:29:33.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65226 req_id = dc566f62-99e5-4b71-bad5-e32fa042f439 response_code = 204 uri = /vpc-routes
29162025-03-04T03:29:33.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61211
29172025-03-04T03:29:33.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61211 req_id = 157f031d-00b8-40c0-9b1e-a682ee5c8cd9 response_code = 200 uri = /v2p
29182025-03-04T03:29:34.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56434
29192025-03-04T03:29:34.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56434 req_id = 10e6fafa-751d-4b0b-ae20-d39e662e1f3f response_code = 200 uri = /vpc-routes
29202025-03-04T03:29:34.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58052
29212025-03-04T03:29:34.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58052 req_id = 0439a8b9-8677-4632-8911-4cc7ddd35359 response_code = 200 uri = /v2p
29222025-03-04T03:29:34.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
29232025-03-04T03:29:34.852ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c
29242025-03-04T03:29:34.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56434 req_id = cb6c1e36-26a5-4215-9aee-2e8cd4185258 response_code = 204 uri = /eip-gateways
29252025-03-04T03:29:34.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56434 req_id = 55bedeaf-d352-425d-a1f7-b381a5d5d939 response_code = 204 uri = /vpc-routes
29262025-03-04T03:29:35.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38105
29272025-03-04T03:29:35.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38105 req_id = 10c34dce-65eb-4438-8592-c36535b25204 response_code = 200 uri = /vpc-routes
29282025-03-04T03:29:35.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
29292025-03-04T03:29:35.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38105 req_id = c8dc479d-ee5d-4cd2-95e4-d3f0102eaa1f response_code = 204 uri = /eip-gateways
29302025-03-04T03:29:35.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38105 req_id = 10a348f5-cf20-4431-809f-c6dfa3f763ab response_code = 204 uri = /vpc-routes
29312025-03-04T03:29:37.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39197
29322025-03-04T03:29:37.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39197 req_id = 14ee5efa-1c21-4df0-b3dd-798e6754313a response_code = 200 uri = /vpc-routes
29332025-03-04T03:29:37.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 5525e426-7299-43ab-ad2b-346968b24e1c values = ExternalIpGatewayMap { mappings: {} }
29342025-03-04T03:29:37.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39197 req_id = 3e06e0bb-03ac-4393-b15e-d1f496a84154 response_code = 204 uri = /eip-gateways
29352025-03-04T03:29:37.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39197 req_id = 004ab9a4-c690-4b15-8685-437053153fb8 response_code = 204 uri = /vpc-routes
29362025-03-04T03:29:37.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64272
29372025-03-04T03:29:37.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64272 req_id = a79e621b-5c84-4e16-9f7e-457e044b4b92 response_code = 200 uri = /v2p
29382025-03-04T03:29:37.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53083
29392025-03-04T03:29:37.620ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4232
29402025-03-04T03:29:37.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4256
29412025-03-04T03:29:37.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53083 req_id = d4a75054-1d11-4902-826a-2afb925918d6 response_code = 204 uri = /switch-ports
29422025-03-04T03:29:37.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53083 req_id = 842981c3-8007-40b0-a073-e7ec194e3abf response_code = 200 uri = /network-bootstore-config