Max level shown:
1 [ Feb 28 10:57:33 Enabled. ]
2 [ Feb 28 10:57:33 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 28 10:57:33 Method "start" exited with status 0. ]
4 [ Feb 28 10:57:33 Rereading configuration. ]
5 [ Feb 28 10:57:33 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-28T10:57:33.724ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-28T10:57:33.725ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-02-28T10:57:33.777ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-02-28T10:57:33.777ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-28T10:57:33.892ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-28T10:57:33.900ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-28T10:57:33.909ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-02-28T10:57:34.510ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-02-28T10:57:34.647ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-28T10:57:34.647ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-28T10:57:34.647ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-28T10:57:34.647ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-28T10:57:34.647ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-02-28T10:57:34.647ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-02-28T10:57:34.650ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-28T10:57:34.650ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-28T10:57:34.650ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-28T10:57:34.650ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-28T10:57:34.650ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-28T10:57:34.650ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-28T10:57:34.650ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-28T10:57:34.650ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-28T10:57:34.650ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-28T10:57:34.662ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-28T10:57:34.662ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool)
322025-02-28T10:57:34.761ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal }
332025-02-28T10:57:35.128ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-28T10:57:35.128ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-28T10:57:35.128ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-28T10:57:35.128ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-28T10:57:35.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-28T10:57:35.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-28T10:57:35.128ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-28T10:57:35.136ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-28T10:57:35.137ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool)
422025-02-28T10:57:35.224ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal }
432025-02-28T10:57:35.580ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
512025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
792025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-02-28T10:57:35.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-02-28T10:57:35.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-02-28T10:57:35.581ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-28T10:57:35.581ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-28T10:57:35.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-02-28T10:57:35.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1022025-02-28T10:57:35.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-02-28T10:57:35.581ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-02-28T10:57:35.581ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-02-28T10:57:35.581ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-28T10:57:35.581ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-28T10:57:35.592ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-28T10:57:35.592ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3037, tv_nsec: 161170381 } time_to_next_cleanup = 599.999923839s
1142025-02-28T10:57:35.592ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1152025-02-28T10:57:35.592ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-02-28T10:57:35.592ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-28T10:57:35.592ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-28T10:57:35.595ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-02-28T10:57:35.597ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-02-28T10:57:35.597ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-28T10:57:35.597ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-28T10:57:35.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-28T10:57:35.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-28T10:57:35.597ZINFOSledAgent (RSS): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-28T10:57:35.597ZINFOSledAgent (RSS): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-28T10:57:35.597ZINFOSledAgent (RSS): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-28T10:57:35.597ZINFOSledAgent (RSS): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-28T10:57:35.597ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-28T10:57:35.597ZINFOSledAgent (RSS): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-28T10:57:35.597ZINFOSledAgent (RSS): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-28T10:57:35.597ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-28T10:57:35.597ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-28T10:57:35.597ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-28T10:57:35.597ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-28T10:57:35.598ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-02-28T10:57:35.598ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-02-28T10:57:35.598ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-02-28T10:57:35.598ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-02-28T10:57:35.598ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e34399da-90ab-4780-9b78-9879d23c2d5f (sled), rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-02-28T10:57:35.599ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-02-28T10:57:35.599ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-02-28T10:57:35.603ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-02-28T10:57:35.609ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-02-28T10:57:35.609ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-02-28T10:57:35.613ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-02-28T10:57:35.613ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-02-28T10:57:35.616ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36317
1482025-02-28T10:57:35.616ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e34399da-90ab-4780-9b78-9879d23c2d5f (sled), rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-02-28T10:57:35.616ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-02-28T10:57:35.616ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-02-28T10:57:35.616ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-02-28T10:57:35.616ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-02-28T10:57:35.616ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-02-28T10:57:35.616ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-02-28T10:57:35.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-28T10:57:35.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-28T10:57:35.664ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-28T10:57:35.692ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1662025-02-28T10:57:35.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-28T10:57:35.692ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1682025-02-28T10:57:35.692ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1692025-02-28T10:57:35.696ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "062f1bc4-bb06-4540-91ce-f0c0f5f0b54c", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "062f1bc4-bb06-4540-91ce-f0c0f5f0b54c" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 120.634616ms
1702025-02-28T10:57:35.706ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-28T10:57:35.731ZINFOSledAgent: successfully created encrypted zvol: name="oxi_ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-28T10:57:35.731ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-28T10:57:35.736ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1742025-02-28T10:57:35.736ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-28T10:57:35.736ZINFOSledAgent (BackingFs): Ensuring dataset oxi_ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-28T10:57:35.803ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-02-28T10:57:35.818ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1782025-02-28T10:57:35.818ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "755a8e82-fced-45dc-9114-a40dfbb6f6d4", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "755a8e82-fced-45dc-9114-a40dfbb6f6d4" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 153.723766ms
1792025-02-28T10:57:35.974ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1802025-02-28T10:57:35.974ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4789f7c9-2ca8-4ba3-a037-43512b3af2ac", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4789f7c9-2ca8-4ba3-a037-43512b3af2ac" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 154.914936ms
1812025-02-28T10:57:36.022ZINFOSledAgent (BackingFs): Mounting oxi_ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-02-28T10:57:36.035ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-02-28T10:57:36.035ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-02-28T10:57:36.035ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-02-28T10:57:36.035ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-02-28T10:57:36.130ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1872025-02-28T10:57:36.131ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e5d13b87-5abe-4881-b8f8-85640092e328", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e5d13b87-5abe-4881-b8f8-85640092e328" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 116.521421ms
1882025-02-28T10:57:36.250ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1892025-02-28T10:57:36.251ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "16766fac-3358-4369-bca3-9075cfea8254", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "16766fac-3358-4369-bca3-9075cfea8254" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 274.380128ms
1902025-02-28T10:57:36.526ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
1912025-02-28T10:57:36.527ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2ecf9be8-04ff-4425-8491-2af496b8b69b", "content-length": "124", "date": "Fri, 28 Feb 2025 10:57:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2ecf9be8-04ff-4425-8491-2af496b8b69b" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 364.486562ms
1922025-02-28T10:57:36.779ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1932025-02-28T10:57:36.785ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:41403 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1942025-02-28T10:57:36.785ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1952025-02-28T10:57:36.785ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:41403 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = e34399da-90ab-4780-9b78-9879d23c2d5f sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1962025-02-28T10:57:36.786ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 305.312655ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1972025-02-28T10:57:36.787ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1982025-02-28T10:57:36.787ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
1992025-02-28T10:57:36.787ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2002025-02-28T10:57:36.787ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-02-28T10:57:36.893ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d262f7b2-3307-4559-9ee9-e967c445259f, sled_id: e34399da-90ab-4780-9b78-9879d23c2d5f }
2022025-02-28T10:57:37.093ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 365.373318ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2032025-02-28T10:57:37.461ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.218641935s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2042025-02-28T10:57:38.682ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.133070583s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2052025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2062025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2072025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2082025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2092025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2102025-02-28T10:57:39.713ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2112025-02-28T10:57:39.715ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2122025-02-28T10:57:39.716ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2132025-02-28T10:57:39.716ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='ab4c631c-e53a-490c-98b2-0e0bd28a6174'/> <propval type="astring" name="rack_id" value='d262f7b2-3307-4559-9ee9-e967c445259f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea6:b6ef'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='d262f7b2-3307-4559-9ee9-e967c445259f'/> <propval type="astring" name="sled_id" value='e34399da-90ab-4780-9b78-9879d23c2d5f'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='d262f7b2-3307-4559-9ee9-e967c445259f'/> <propval type="astring" name="sled_id" value='e34399da-90ab-4780-9b78-9879d23c2d5f'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e34399da-90ab-4780-9b78-9879d23c2d5f'/> <propval type="astring" name="rack_uuid" value='d262f7b2-3307-4559-9ee9-e967c445259f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e34399da-90ab-4780-9b78-9879d23c2d5f'/> <propval type="astring" name="rack_uuid" value='d262f7b2-3307-4559-9ee9-e967c445259f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-02-28T10:57:39.717ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2152025-02-28T10:57:39.817ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.968525451s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2162025-02-28T10:57:39.974ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 58.319842ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-02-28T10:57:40.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 108.856167ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-02-28T10:57:40.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 262.788344ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-02-28T10:57:40.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 388.52526ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-02-28T10:57:41.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 822.686725ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-28T10:57:42.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.367688692s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-02-28T10:57:43.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 582.592076ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-02-28T10:57:44.171ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 826.055156ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-28T10:57:44.787ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.68103023s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2252025-02-28T10:57:45.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 758.298879ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-02-28T10:57:46.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-02-28T10:57:46.238ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2282025-02-28T10:57:46.239ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-02-28T10:57:46.239ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2302025-02-28T10:57:46.239ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-02-28T10:57:46.239ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-02-28T10:57:46.240ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-02-28T10:57:46.240ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-02-28T10:57:46.240ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-02-28T10:57:46.240ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2362025-02-28T10:57:46.435ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:36317
2372025-02-28T10:57:46.436ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382025-02-28T10:57:46.436ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-02-28T10:57:46.441ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-02-28T10:57:46.441ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2412025-02-28T10:57:46.441ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2422025-02-28T10:57:46.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34078
2432025-02-28T10:57:46.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-02-28T10:57:46.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-02-28T10:57:46.701ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-02-28T10:57:46.701ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-02-28T10:57:46.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34078 req_id = 6bbcb570-f845-4907-8cbc-adf07163dfea response_code = 200 uri = /inventory
2482025-02-28T10:57:46.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50931
2492025-02-28T10:57:46.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50931 req_id = 46fb579c-e55a-43c0-874c-ec37a8cd2b87 response_code = 200 uri = /sled-role
2502025-02-28T10:57:46.764ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3ce1544b-ac00-4993-95d8-0db357b7bd52 (physical_disk), pool_id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 41229a03-0f44-4336-bb1e-d1bea31712a0 (physical_disk), pool_id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 612f042b-394a-4af5-9bf2-a4572b0a25be (physical_disk), pool_id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9d2b759e-3e03-4757-8a97-eecc2fb6a552 (physical_disk), pool_id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a71ecd4f-55f6-479b-a486-3925a6c80693 (physical_disk), pool_id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b7d3057e-7613-4f2b-b42a-a1820e358114 (physical_disk), pool_id: c223d649-aefc-4563-b832-624daf4863fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eac6a0b2-1600-4aa9-aa61-e466f1299d3b (physical_disk), pool_id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f34592fa-ddd7-454b-b176-8ab204d90a1a (physical_disk), pool_id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f757dddd-dc24-4ece-a2fc-c70fc4424275 (physical_disk), pool_id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512025-02-28T10:57:46.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61447
2522025-02-28T10:57:46.767ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2532025-02-28T10:57:46.767ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3ce1544b-ac00-4993-95d8-0db357b7bd52 (physical_disk), pool_id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 41229a03-0f44-4336-bb1e-d1bea31712a0 (physical_disk), pool_id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 612f042b-394a-4af5-9bf2-a4572b0a25be (physical_disk), pool_id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9d2b759e-3e03-4757-8a97-eecc2fb6a552 (physical_disk), pool_id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a71ecd4f-55f6-479b-a486-3925a6c80693 (physical_disk), pool_id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b7d3057e-7613-4f2b-b42a-a1820e358114 (physical_disk), pool_id: c223d649-aefc-4563-b832-624daf4863fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eac6a0b2-1600-4aa9-aa61-e466f1299d3b (physical_disk), pool_id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f34592fa-ddd7-454b-b176-8ab204d90a1a (physical_disk), pool_id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f757dddd-dc24-4ece-a2fc-c70fc4424275 (physical_disk), pool_id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542025-02-28T10:57:46.767ZINFOSledAgent (StorageManager): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-02-28T10:57:46.767ZINFOSledAgent (StorageManager): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-02-28T10:57:46.767ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572025-02-28T10:57:46.767ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582025-02-28T10:57:46.767ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592025-02-28T10:57:46.767ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602025-02-28T10:57:46.767ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612025-02-28T10:57:46.886ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4944121016667480812 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2622025-02-28T10:57:46.886ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4289814308619955082 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2632025-02-28T10:57:46.892ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642025-02-28T10:57:46.892ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool)
2652025-02-28T10:57:47.084ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2662025-02-28T10:57:47.180ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }
2672025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-02-28T10:57:47.188ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-02-28T10:57:47.224ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-02-28T10:57:47.233ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-02-28T10:57:47.240ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
2772025-02-28T10:57:47.375ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd file = sled-storage/src/dataset.rs:388
2782025-02-28T10:57:47.383ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-02-28T10:57:47.383ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-02-28T10:57:47.383ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-02-28T10:57:47.383ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-02-28T10:57:47.383ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-02-28T10:57:47.392ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-02-28T10:57:47.392ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 198de296-2120-47e0-aaa7-ce837077a9bd (zpool)
2852025-02-28T10:57:47.485ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }
2862025-02-28T10:57:47.493ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-02-28T10:57:47.493ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-02-28T10:57:47.493ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-02-28T10:57:47.493ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-02-28T10:57:47.493ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-02-28T10:57:47.494ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-02-28T10:57:47.494ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-02-28T10:57:47.529ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-02-28T10:57:47.539ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-02-28T10:57:47.670ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_198de296-2120-47e0-aaa7-ce837077a9bd file = sled-storage/src/dataset.rs:388
2962025-02-28T10:57:47.678ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-02-28T10:57:47.678ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-02-28T10:57:47.678ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-02-28T10:57:47.678ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-02-28T10:57:47.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-02-28T10:57:47.688ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-02-28T10:57:47.688ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool)
3032025-02-28T10:57:47.779ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }
3042025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-02-28T10:57:47.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-02-28T10:57:47.823ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-02-28T10:57:47.831ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-02-28T10:57:47.966ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3 file = sled-storage/src/dataset.rs:388
3142025-02-28T10:57:47.974ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-02-28T10:57:47.975ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-02-28T10:57:47.975ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-02-28T10:57:47.975ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-02-28T10:57:47.975ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-02-28T10:57:47.984ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-02-28T10:57:47.984ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3c8d4110-32ba-46e1-8821-6881348da454 (zpool)
3212025-02-28T10:57:48.078ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }
3222025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-02-28T10:57:48.086ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-02-28T10:57:48.120ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-02-28T10:57:48.127ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-02-28T10:57:48.243ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
3322025-02-28T10:57:48.268ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3c8d4110-32ba-46e1-8821-6881348da454 file = sled-storage/src/dataset.rs:388
3332025-02-28T10:57:48.277ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-02-28T10:57:48.277ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-02-28T10:57:48.277ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-02-28T10:57:48.277ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-02-28T10:57:48.277ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-02-28T10:57:48.287ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-02-28T10:57:48.287ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool)
3402025-02-28T10:57:48.380ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }
3412025-02-28T10:57:48.388ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-02-28T10:57:48.388ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-02-28T10:57:48.388ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-02-28T10:57:48.388ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-02-28T10:57:48.388ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-02-28T10:57:48.389ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-02-28T10:57:48.389ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-02-28T10:57:48.425ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-02-28T10:57:48.433ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-02-28T10:57:48.570ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e file = sled-storage/src/dataset.rs:388
3512025-02-28T10:57:48.578ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-02-28T10:57:48.578ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-02-28T10:57:48.578ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-02-28T10:57:48.578ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-02-28T10:57:48.578ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-02-28T10:57:48.588ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-02-28T10:57:48.588ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool)
3582025-02-28T10:57:48.684ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }
3592025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-02-28T10:57:48.691ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-02-28T10:57:48.692ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-02-28T10:57:48.725ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-02-28T10:57:48.732ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-02-28T10:57:48.868ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf file = sled-storage/src/dataset.rs:388
3692025-02-28T10:57:48.876ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-02-28T10:57:48.876ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-02-28T10:57:48.876ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-02-28T10:57:48.876ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-02-28T10:57:48.876ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-02-28T10:57:48.886ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-02-28T10:57:48.886ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c223d649-aefc-4563-b832-624daf4863fe (zpool)
3762025-02-28T10:57:48.982ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }
3772025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-02-28T10:57:48.990ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-02-28T10:57:49.027ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-02-28T10:57:49.035ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c223d649-aefc-4563-b832-624daf4863fe/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-02-28T10:57:49.171ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c223d649-aefc-4563-b832-624daf4863fe file = sled-storage/src/dataset.rs:388
3872025-02-28T10:57:49.179ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882025-02-28T10:57:49.179ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892025-02-28T10:57:49.179ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902025-02-28T10:57:49.179ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912025-02-28T10:57:49.179ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922025-02-28T10:57:49.188ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932025-02-28T10:57:49.188ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool)
3942025-02-28T10:57:49.280ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }
3952025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-02-28T10:57:49.289ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022025-02-28T10:57:49.293ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4032025-02-28T10:57:49.324ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-02-28T10:57:49.332ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-02-28T10:57:49.474ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_191404b5-bb5f-4942-aade-4f02119d69b0 file = sled-storage/src/dataset.rs:388
4062025-02-28T10:57:49.483ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-02-28T10:57:49.483ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-02-28T10:57:49.483ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-02-28T10:57:49.483ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-02-28T10:57:49.483ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-02-28T10:57:49.492ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-02-28T10:57:49.493ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool)
4132025-02-28T10:57:49.596ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }
4142025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-02-28T10:57:49.605ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-02-28T10:57:49.641ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-02-28T10:57:49.649ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-02-28T10:57:49.801ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75 file = sled-storage/src/dataset.rs:388
4242025-02-28T10:57:49.810ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-02-28T10:57:49.810ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-02-28T10:57:49.810ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-02-28T10:57:49.810ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7aa7093c-069b-4cb1-ae18-35dd530e3c7e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-02-28T10:57:49.810ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-02-28T10:57:49.810ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-02-28T10:57:49.810ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-02-28T10:57:49.810ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4322025-02-28T10:57:49.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-02-28T10:57:49.810ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4342025-02-28T10:57:49.810ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4352025-02-28T10:57:49.810ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4362025-02-28T10:57:49.810ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4372025-02-28T10:57:49.810ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4382025-02-28T10:57:49.810ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-02-28T10:57:49.811ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4402025-02-28T10:57:49.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3043775 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61447 req_id = dac175c4-019e-4c95-98d0-92e2e3f68587 response_code = 200 uri = /omicron-physical-disks
4412025-02-28T10:57:49.843ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0100fa73-5df4-4303-a6a8-e6e6bf49c828 (dataset): DatasetConfig { id: 0100fa73-5df4-4303-a6a8-e6e6bf49c828 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03ef9a30-5190-47d0-afe7-f5fc83dac700 (dataset): DatasetConfig { id: 03ef9a30-5190-47d0-afe7-f5fc83dac700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 165060cb-6813-4510-a61b-2d6f61d5769d (dataset): DatasetConfig { id: 165060cb-6813-4510-a61b-2d6f61d5769d (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1779e65f-3772-4492-af1d-8fea39faaab9 (dataset): DatasetConfig { id: 1779e65f-3772-4492-af1d-8fea39faaab9 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183f05dc-8afc-4f3f-9bbc-d406438b3e53 (dataset): DatasetConfig { id: 183f05dc-8afc-4f3f-9bbc-d406438b3e53 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e37914a-de6e-40df-85ed-d474e56b697b (dataset): DatasetConfig { id: 1e37914a-de6e-40df-85ed-d474e56b697b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 286b3964-0bbe-4e85-a9b1-049cc2947511 (dataset): DatasetConfig { id: 286b3964-0bbe-4e85-a9b1-049cc2947511 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cd9e360-605e-4175-bc3a-bdd9771d2b4c (dataset): DatasetConfig { id: 2cd9e360-605e-4175-bc3a-bdd9771d2b4c (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2eae4c1c-b1cd-454a-a658-4328ac89c4b3 (dataset): DatasetConfig { id: 2eae4c1c-b1cd-454a-a658-4328ac89c4b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f9137e6-2f42-4f0b-ae61-6b308abf5f04 (dataset): DatasetConfig { id: 2f9137e6-2f42-4f0b-ae61-6b308abf5f04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33541221-c3b5-42b4-8bfb-9a92931b4751 (dataset): DatasetConfig { id: 33541221-c3b5-42b4-8bfb-9a92931b4751 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335c6144-7941-4d5d-85a9-55baccc75f77 (dataset): DatasetConfig { id: 335c6144-7941-4d5d-85a9-55baccc75f77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 358d2eb9-878d-42e0-81ba-eeff512df10a (dataset): DatasetConfig { id: 358d2eb9-878d-42e0-81ba-eeff512df10a (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b164a9a-7c8d-476c-9168-16f1da35c550 (dataset): DatasetConfig { id: 3b164a9a-7c8d-476c-9168-16f1da35c550 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3d31494f-3bfa-41ac-8c36-925357dd6e1c (dataset): DatasetConfig { id: 3d31494f-3bfa-41ac-8c36-925357dd6e1c (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f577ecd-9f16-4af3-b2cb-82abbc912a76 (dataset): DatasetConfig { id: 3f577ecd-9f16-4af3-b2cb-82abbc912a76 (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 418a814a-d2e8-4c9b-8067-21e4d8a26de0 (dataset): DatasetConfig { id: 418a814a-d2e8-4c9b-8067-21e4d8a26de0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 434e7e8e-13d9-4066-8596-578b1cbde340 (dataset): DatasetConfig { id: 434e7e8e-13d9-4066-8596-578b1cbde340 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 47a644da-a3c1-472f-9065-b98beb07007f (dataset): DatasetConfig { id: 47a644da-a3c1-472f-9065-b98beb07007f (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b91b64c-4fe8-4b9a-b747-8c514f9ed362 (dataset): DatasetConfig { id: 4b91b64c-4fe8-4b9a-b747-8c514f9ed362 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c302778-4b3e-4423-a4d8-464b4c3605bb (dataset): DatasetConfig { id: 5c302778-4b3e-4423-a4d8-464b4c3605bb (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d7596b5-7c58-4703-a0ff-5e8a42a224e8 (dataset): DatasetConfig { id: 5d7596b5-7c58-4703-a0ff-5e8a42a224e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 611e1e65-3315-49f1-a8fa-b09271b1e32b (dataset): DatasetConfig { id: 611e1e65-3315-49f1-a8fa-b09271b1e32b (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63157d79-a89e-4d1b-8757-5f18fa8d6002 (dataset): DatasetConfig { id: 63157d79-a89e-4d1b-8757-5f18fa8d6002 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65069f79-a767-41ac-bfbf-917bafcbdfe2 (dataset): DatasetConfig { id: 65069f79-a767-41ac-bfbf-917bafcbdfe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 665f6acd-5a38-4747-ada5-6ba42034743d (dataset): DatasetConfig { id: 665f6acd-5a38-4747-ada5-6ba42034743d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72cb80f3-f5e8-48bd-8fe3-7e0d423a83a6 (dataset): DatasetConfig { id: 72cb80f3-f5e8-48bd-8fe3-7e0d423a83a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74e9fd1a-8fd0-40a1-9d2a-3ab11a9f9377 (dataset): DatasetConfig { id: 74e9fd1a-8fd0-40a1-9d2a-3ab11a9f9377 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 783cb5d6-dbd4-4152-8dfa-acf4b82cd2f8 (dataset): DatasetConfig { id: 783cb5d6-dbd4-4152-8dfa-acf4b82cd2f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ccb1f09-29f6-4bbe-9135-752f23682a06 (dataset): DatasetConfig { id: 7ccb1f09-29f6-4bbe-9135-752f23682a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f1ee102-1047-4858-9704-6753c611cff9 (dataset): DatasetConfig { id: 7f1ee102-1047-4858-9704-6753c611cff9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f67a693-0c3c-4ade-a63b-b638e3d38077 (dataset): DatasetConfig { id: 7f67a693-0c3c-4ade-a63b-b638e3d38077 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81714bf4-7aab-479e-8c9e-3e2b1f1b88e7 (dataset): DatasetConfig { id: 81714bf4-7aab-479e-8c9e-3e2b1f1b88e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84572d46-41d3-41a7-b46b-4ac1753c514b (dataset): DatasetConfig { id: 84572d46-41d3-41a7-b46b-4ac1753c514b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 850a04e3-2416-49a4-97c7-1030480aa2dd (dataset): DatasetConfig { id: 850a04e3-2416-49a4-97c7-1030480aa2dd (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8546ecee-a909-4fbd-a2b2-bd6a9527d54b (dataset): DatasetConfig { id: 8546ecee-a909-4fbd-a2b2-bd6a9527d54b (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 857afb62-9182-4da4-bca3-21e1855ecad6 (dataset): DatasetConfig { id: 857afb62-9182-4da4-bca3-21e1855ecad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86c78f69-a509-4ec7-b132-c13a1bfbc040 (dataset): DatasetConfig { id: 86c78f69-a509-4ec7-b132-c13a1bfbc040 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 93386715-0fac-43cb-b9e4-6fbf0c93e34f (dataset): DatasetConfig { id: 93386715-0fac-43cb-b9e4-6fbf0c93e34f (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 973a69e9-fab4-44fd-a1f2-e46f6298f0f3 (dataset): DatasetConfig { id: 973a69e9-fab4-44fd-a1f2-e46f6298f0f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9766bdb6-75ec-4530-b09d-986580735743 (dataset): DatasetConfig { id: 9766bdb6-75ec-4530-b09d-986580735743 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98485713-9f7d-4a55-a90e-ac1978afc270 (dataset): DatasetConfig { id: 98485713-9f7d-4a55-a90e-ac1978afc270 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a47ea12-7ed9-44cb-ba0f-c17612e38889 (dataset): DatasetConfig { id: 9a47ea12-7ed9-44cb-ba0f-c17612e38889 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a5e4ad5-3775-452a-a078-7ad576bdefb0 (dataset): DatasetConfig { id: 9a5e4ad5-3775-452a-a078-7ad576bdefb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a09eebc9-184d-4a35-babc-8e0269fc5927 (dataset): DatasetConfig { id: a09eebc9-184d-4a35-babc-8e0269fc5927 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a101dcb6-01eb-4159-abbf-c694cad9b451 (dataset): DatasetConfig { id: a101dcb6-01eb-4159-abbf-c694cad9b451 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9640d73-d7d9-45b3-839b-74cbab70beea (dataset): DatasetConfig { id: a9640d73-d7d9-45b3-839b-74cbab70beea (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae08c725-4c6e-4ad6-9e90-d4c0811f4741 (dataset): DatasetConfig { id: ae08c725-4c6e-4ad6-9e90-d4c0811f4741 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeb4b046-1e0c-4fa2-946d-d7c5fddf355b (dataset): DatasetConfig { id: aeb4b046-1e0c-4fa2-946d-d7c5fddf355b (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af941c71-b54d-4098-bd2e-ee109520f569 (dataset): DatasetConfig { id: af941c71-b54d-4098-bd2e-ee109520f569 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b289e628-c740-4bca-9ab0-48f1a0a153a3 (dataset): DatasetConfig { id: b289e628-c740-4bca-9ab0-48f1a0a153a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b53335c1-a560-4b0f-a02c-77766ca90114 (dataset): DatasetConfig { id: b53335c1-a560-4b0f-a02c-77766ca90114 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b806582b-07e1-40c1-9759-eb22c573bc5f (dataset): DatasetConfig { id: b806582b-07e1-40c1-9759-eb22c573bc5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9662848-52c9-4009-aa39-be1f9072ebc7 (dataset): DatasetConfig { id: b9662848-52c9-4009-aa39-be1f9072ebc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba307d22-8f73-40f7-97d3-acaebde31ee3 (dataset): DatasetConfig { id: ba307d22-8f73-40f7-97d3-acaebde31ee3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c60e886a-9cae-46bd-a2e0-70670a6ca8c8 (dataset): DatasetConfig { id: c60e886a-9cae-46bd-a2e0-70670a6ca8c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7953694-b886-4ce0-adfc-943d5dc7c31c (dataset): DatasetConfig { id: c7953694-b886-4ce0-adfc-943d5dc7c31c (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7da1357-87b1-4225-a69a-f7eab3b2a1f2 (dataset): DatasetConfig { id: c7da1357-87b1-4225-a69a-f7eab3b2a1f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8eb8335-6870-4618-88c7-457cfa2eb700 (dataset): DatasetConfig { id: c8eb8335-6870-4618-88c7-457cfa2eb700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca5c1097-958c-4e91-bf8e-dc34b227cd06 (dataset): DatasetConfig { id: ca5c1097-958c-4e91-bf8e-dc34b227cd06 (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d636f4c5-ded8-4ac1-8a4b-4953d6ba8c3f (dataset): DatasetConfig { id: d636f4c5-ded8-4ac1-8a4b-4953d6ba8c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6c038e6-a5e7-4374-b4f7-3ad423205e5c (dataset): DatasetConfig { id: d6c038e6-a5e7-4374-b4f7-3ad423205e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9a643cd-8706-47d6-a3d5-1b2e57a9fe13 (dataset): DatasetConfig { id: d9a643cd-8706-47d6-a3d5-1b2e57a9fe13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daf74de8-478a-43d9-bc28-a96bc5700e64 (dataset): DatasetConfig { id: daf74de8-478a-43d9-bc28-a96bc5700e64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db6109e2-2f56-429f-933f-5c903384d928 (dataset): DatasetConfig { id: db6109e2-2f56-429f-933f-5c903384d928 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5212c84-9df4-4294-955b-90227f077243 (dataset): DatasetConfig { id: f5212c84-9df4-4294-955b-90227f077243 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-02-28T10:57:49.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62988
4432025-02-28T10:57:49.844ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4442025-02-28T10:57:49.844ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0100fa73-5df4-4303-a6a8-e6e6bf49c828 (dataset): DatasetConfig { id: 0100fa73-5df4-4303-a6a8-e6e6bf49c828 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03ef9a30-5190-47d0-afe7-f5fc83dac700 (dataset): DatasetConfig { id: 03ef9a30-5190-47d0-afe7-f5fc83dac700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 165060cb-6813-4510-a61b-2d6f61d5769d (dataset): DatasetConfig { id: 165060cb-6813-4510-a61b-2d6f61d5769d (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1779e65f-3772-4492-af1d-8fea39faaab9 (dataset): DatasetConfig { id: 1779e65f-3772-4492-af1d-8fea39faaab9 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183f05dc-8afc-4f3f-9bbc-d406438b3e53 (dataset): DatasetConfig { id: 183f05dc-8afc-4f3f-9bbc-d406438b3e53 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e37914a-de6e-40df-85ed-d474e56b697b (dataset): DatasetConfig { id: 1e37914a-de6e-40df-85ed-d474e56b697b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 286b3964-0bbe-4e85-a9b1-049cc2947511 (dataset): DatasetConfig { id: 286b3964-0bbe-4e85-a9b1-049cc2947511 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cd9e360-605e-4175-bc3a-bdd9771d2b4c (dataset): DatasetConfig { id: 2cd9e360-605e-4175-bc3a-bdd9771d2b4c (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2eae4c1c-b1cd-454a-a658-4328ac89c4b3 (dataset): DatasetConfig { id: 2eae4c1c-b1cd-454a-a658-4328ac89c4b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f9137e6-2f42-4f0b-ae61-6b308abf5f04 (dataset): DatasetConfig { id: 2f9137e6-2f42-4f0b-ae61-6b308abf5f04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33541221-c3b5-42b4-8bfb-9a92931b4751 (dataset): DatasetConfig { id: 33541221-c3b5-42b4-8bfb-9a92931b4751 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335c6144-7941-4d5d-85a9-55baccc75f77 (dataset): DatasetConfig { id: 335c6144-7941-4d5d-85a9-55baccc75f77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 358d2eb9-878d-42e0-81ba-eeff512df10a (dataset): DatasetConfig { id: 358d2eb9-878d-42e0-81ba-eeff512df10a (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b164a9a-7c8d-476c-9168-16f1da35c550 (dataset): DatasetConfig { id: 3b164a9a-7c8d-476c-9168-16f1da35c550 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3d31494f-3bfa-41ac-8c36-925357dd6e1c (dataset): DatasetConfig { id: 3d31494f-3bfa-41ac-8c36-925357dd6e1c (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f577ecd-9f16-4af3-b2cb-82abbc912a76 (dataset): DatasetConfig { id: 3f577ecd-9f16-4af3-b2cb-82abbc912a76 (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 418a814a-d2e8-4c9b-8067-21e4d8a26de0 (dataset): DatasetConfig { id: 418a814a-d2e8-4c9b-8067-21e4d8a26de0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 434e7e8e-13d9-4066-8596-578b1cbde340 (dataset): DatasetConfig { id: 434e7e8e-13d9-4066-8596-578b1cbde340 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 47a644da-a3c1-472f-9065-b98beb07007f (dataset): DatasetConfig { id: 47a644da-a3c1-472f-9065-b98beb07007f (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b91b64c-4fe8-4b9a-b747-8c514f9ed362 (dataset): DatasetConfig { id: 4b91b64c-4fe8-4b9a-b747-8c514f9ed362 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c302778-4b3e-4423-a4d8-464b4c3605bb (dataset): DatasetConfig { id: 5c302778-4b3e-4423-a4d8-464b4c3605bb (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d7596b5-7c58-4703-a0ff-5e8a42a224e8 (dataset): DatasetConfig { id: 5d7596b5-7c58-4703-a0ff-5e8a42a224e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 611e1e65-3315-49f1-a8fa-b09271b1e32b (dataset): DatasetConfig { id: 611e1e65-3315-49f1-a8fa-b09271b1e32b (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63157d79-a89e-4d1b-8757-5f18fa8d6002 (dataset): DatasetConfig { id: 63157d79-a89e-4d1b-8757-5f18fa8d6002 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65069f79-a767-41ac-bfbf-917bafcbdfe2 (dataset): DatasetConfig { id: 65069f79-a767-41ac-bfbf-917bafcbdfe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 665f6acd-5a38-4747-ada5-6ba42034743d (dataset): DatasetConfig { id: 665f6acd-5a38-4747-ada5-6ba42034743d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72cb80f3-f5e8-48bd-8fe3-7e0d423a83a6 (dataset): DatasetConfig { id: 72cb80f3-f5e8-48bd-8fe3-7e0d423a83a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74e9fd1a-8fd0-40a1-9d2a-3ab11a9f9377 (dataset): DatasetConfig { id: 74e9fd1a-8fd0-40a1-9d2a-3ab11a9f9377 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 783cb5d6-dbd4-4152-8dfa-acf4b82cd2f8 (dataset): DatasetConfig { id: 783cb5d6-dbd4-4152-8dfa-acf4b82cd2f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ccb1f09-29f6-4bbe-9135-752f23682a06 (dataset): DatasetConfig { id: 7ccb1f09-29f6-4bbe-9135-752f23682a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f1ee102-1047-4858-9704-6753c611cff9 (dataset): DatasetConfig { id: 7f1ee102-1047-4858-9704-6753c611cff9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f67a693-0c3c-4ade-a63b-b638e3d38077 (dataset): DatasetConfig { id: 7f67a693-0c3c-4ade-a63b-b638e3d38077 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81714bf4-7aab-479e-8c9e-3e2b1f1b88e7 (dataset): DatasetConfig { id: 81714bf4-7aab-479e-8c9e-3e2b1f1b88e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84572d46-41d3-41a7-b46b-4ac1753c514b (dataset): DatasetConfig { id: 84572d46-41d3-41a7-b46b-4ac1753c514b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 850a04e3-2416-49a4-97c7-1030480aa2dd (dataset): DatasetConfig { id: 850a04e3-2416-49a4-97c7-1030480aa2dd (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8546ecee-a909-4fbd-a2b2-bd6a9527d54b (dataset): DatasetConfig { id: 8546ecee-a909-4fbd-a2b2-bd6a9527d54b (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 857afb62-9182-4da4-bca3-21e1855ecad6 (dataset): DatasetConfig { id: 857afb62-9182-4da4-bca3-21e1855ecad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86c78f69-a509-4ec7-b132-c13a1bfbc040 (dataset): DatasetConfig { id: 86c78f69-a509-4ec7-b132-c13a1bfbc040 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 93386715-0fac-43cb-b9e4-6fbf0c93e34f (dataset): DatasetConfig { id: 93386715-0fac-43cb-b9e4-6fbf0c93e34f (dataset), name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 973a69e9-fab4-44fd-a1f2-e46f6298f0f3 (dataset): DatasetConfig { id: 973a69e9-fab4-44fd-a1f2-e46f6298f0f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9766bdb6-75ec-4530-b09d-986580735743 (dataset): DatasetConfig { id: 9766bdb6-75ec-4530-b09d-986580735743 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98485713-9f7d-4a55-a90e-ac1978afc270 (dataset): DatasetConfig { id: 98485713-9f7d-4a55-a90e-ac1978afc270 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a47ea12-7ed9-44cb-ba0f-c17612e38889 (dataset): DatasetConfig { id: 9a47ea12-7ed9-44cb-ba0f-c17612e38889 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a5e4ad5-3775-452a-a078-7ad576bdefb0 (dataset): DatasetConfig { id: 9a5e4ad5-3775-452a-a078-7ad576bdefb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a09eebc9-184d-4a35-babc-8e0269fc5927 (dataset): DatasetConfig { id: a09eebc9-184d-4a35-babc-8e0269fc5927 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a101dcb6-01eb-4159-abbf-c694cad9b451 (dataset): DatasetConfig { id: a101dcb6-01eb-4159-abbf-c694cad9b451 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9640d73-d7d9-45b3-839b-74cbab70beea (dataset): DatasetConfig { id: a9640d73-d7d9-45b3-839b-74cbab70beea (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae08c725-4c6e-4ad6-9e90-d4c0811f4741 (dataset): DatasetConfig { id: ae08c725-4c6e-4ad6-9e90-d4c0811f4741 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeb4b046-1e0c-4fa2-946d-d7c5fddf355b (dataset): DatasetConfig { id: aeb4b046-1e0c-4fa2-946d-d7c5fddf355b (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, af941c71-b54d-4098-bd2e-ee109520f569 (dataset): DatasetConfig { id: af941c71-b54d-4098-bd2e-ee109520f569 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b289e628-c740-4bca-9ab0-48f1a0a153a3 (dataset): DatasetConfig { id: b289e628-c740-4bca-9ab0-48f1a0a153a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b53335c1-a560-4b0f-a02c-77766ca90114 (dataset): DatasetConfig { id: b53335c1-a560-4b0f-a02c-77766ca90114 (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b806582b-07e1-40c1-9759-eb22c573bc5f (dataset): DatasetConfig { id: b806582b-07e1-40c1-9759-eb22c573bc5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9662848-52c9-4009-aa39-be1f9072ebc7 (dataset): DatasetConfig { id: b9662848-52c9-4009-aa39-be1f9072ebc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba307d22-8f73-40f7-97d3-acaebde31ee3 (dataset): DatasetConfig { id: ba307d22-8f73-40f7-97d3-acaebde31ee3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c60e886a-9cae-46bd-a2e0-70670a6ca8c8 (dataset): DatasetConfig { id: c60e886a-9cae-46bd-a2e0-70670a6ca8c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7953694-b886-4ce0-adfc-943d5dc7c31c (dataset): DatasetConfig { id: c7953694-b886-4ce0-adfc-943d5dc7c31c (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7da1357-87b1-4225-a69a-f7eab3b2a1f2 (dataset): DatasetConfig { id: c7da1357-87b1-4225-a69a-f7eab3b2a1f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8eb8335-6870-4618-88c7-457cfa2eb700 (dataset): DatasetConfig { id: c8eb8335-6870-4618-88c7-457cfa2eb700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca5c1097-958c-4e91-bf8e-dc34b227cd06 (dataset): DatasetConfig { id: ca5c1097-958c-4e91-bf8e-dc34b227cd06 (dataset), name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d636f4c5-ded8-4ac1-8a4b-4953d6ba8c3f (dataset): DatasetConfig { id: d636f4c5-ded8-4ac1-8a4b-4953d6ba8c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6c038e6-a5e7-4374-b4f7-3ad423205e5c (dataset): DatasetConfig { id: d6c038e6-a5e7-4374-b4f7-3ad423205e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9a643cd-8706-47d6-a3d5-1b2e57a9fe13 (dataset): DatasetConfig { id: d9a643cd-8706-47d6-a3d5-1b2e57a9fe13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daf74de8-478a-43d9-bc28-a96bc5700e64 (dataset): DatasetConfig { id: daf74de8-478a-43d9-bc28-a96bc5700e64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db6109e2-2f56-429f-933f-5c903384d928 (dataset): DatasetConfig { id: db6109e2-2f56-429f-933f-5c903384d928 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5212c84-9df4-4294-955b-90227f077243 (dataset): DatasetConfig { id: f5212c84-9df4-4294-955b-90227f077243 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-02-28T10:57:49.844ZINFOSledAgent (StorageManager): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-02-28T10:57:49.844ZINFOSledAgent (StorageManager): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-02-28T10:57:49.844ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-02-28T10:57:49.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-02-28T10:57:49.860ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-02-28T10:57:49.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crucible" } file = sled-storage/src/manager.rs:1431
4512025-02-28T10:57:49.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-02-28T10:57:49.910ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-02-28T10:57:49.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone/oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), full_name: "oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone/oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8" } file = sled-storage/src/manager.rs:1431
4542025-02-28T10:57:49.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-02-28T10:57:49.971ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562025-02-28T10:57:49.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/debug"), full_name: "oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/debug" } file = sled-storage/src/manager.rs:1431
4572025-02-28T10:57:50.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-02-28T10:57:50.001ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-02-28T10:57:50.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crucible" } file = sled-storage/src/manager.rs:1431
4602025-02-28T10:57:50.051ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-02-28T10:57:50.051ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622025-02-28T10:57:50.051ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4632025-02-28T10:57:50.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-02-28T10:57:50.101ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-02-28T10:57:50.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070" } file = sled-storage/src/manager.rs:1431
4662025-02-28T10:57:50.162ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-02-28T10:57:50.162ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-02-28T10:57:50.162ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone/oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3"), full_name: "oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone/oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3" } file = sled-storage/src/manager.rs:1431
4692025-02-28T10:57:50.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-02-28T10:57:50.221ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4712025-02-28T10:57:50.221ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/debug"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/debug" } file = sled-storage/src/manager.rs:1431
4722025-02-28T10:57:50.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-02-28T10:57:50.251ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742025-02-28T10:57:50.251ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad" } file = sled-storage/src/manager.rs:1431
4752025-02-28T10:57:50.296ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
4762025-02-28T10:57:50.311ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-02-28T10:57:50.311ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-02-28T10:57:50.311ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a" } file = sled-storage/src/manager.rs:1431
4792025-02-28T10:57:50.370ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-02-28T10:57:50.370ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-02-28T10:57:50.370ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crucible" } file = sled-storage/src/manager.rs:1431
4822025-02-28T10:57:50.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-02-28T10:57:50.416ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-02-28T10:57:50.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298" } file = sled-storage/src/manager.rs:1431
4852025-02-28T10:57:50.478ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-02-28T10:57:50.478ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-02-28T10:57:50.478ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4882025-02-28T10:57:50.528ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-02-28T10:57:50.528ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4902025-02-28T10:57:50.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/debug"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/debug" } file = sled-storage/src/manager.rs:1431
4912025-02-28T10:57:50.558ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-02-28T10:57:50.558ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932025-02-28T10:57:50.558ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c223d649-aefc-4563-b832-624daf4863fe/crypt/debug"), full_name: "oxp_c223d649-aefc-4563-b832-624daf4863fe/crypt/debug" } file = sled-storage/src/manager.rs:1431
4942025-02-28T10:57:50.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-02-28T10:57:50.588ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-02-28T10:57:50.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c223d649-aefc-4563-b832-624daf4863fe/crypt/zone/oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331"), full_name: "oxp_c223d649-aefc-4563-b832-624daf4863fe/crypt/zone/oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331" } file = sled-storage/src/manager.rs:1431
4972025-02-28T10:57:50.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-02-28T10:57:50.648ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-02-28T10:57:50.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5002025-02-28T10:57:50.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-02-28T10:57:50.697ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022025-02-28T10:57:50.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/debug"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/debug" } file = sled-storage/src/manager.rs:1431
5032025-02-28T10:57:50.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-02-28T10:57:50.726ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052025-02-28T10:57:50.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone" } file = sled-storage/src/manager.rs:1431
5062025-02-28T10:57:50.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-02-28T10:57:50.756ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-02-28T10:57:50.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5092025-02-28T10:57:50.805ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-02-28T10:57:50.805ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-02-28T10:57:50.805ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone/oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone/oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170" } file = sled-storage/src/manager.rs:1431
5122025-02-28T10:57:50.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-02-28T10:57:50.864ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-02-28T10:57:50.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crucible" } file = sled-storage/src/manager.rs:1431
5152025-02-28T10:57:50.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-02-28T10:57:50.912ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-02-28T10:57:50.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone" } file = sled-storage/src/manager.rs:1431
5182025-02-28T10:57:50.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-02-28T10:57:50.942ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-02-28T10:57:50.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone/oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a"), full_name: "oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone/oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a" } file = sled-storage/src/manager.rs:1431
5212025-02-28T10:57:50.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-02-28T10:57:51.000ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232025-02-28T10:57:51.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5" } file = sled-storage/src/manager.rs:1431
5242025-02-28T10:57:51.062ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-02-28T10:57:51.062ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-02-28T10:57:51.062ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065" } file = sled-storage/src/manager.rs:1431
5272025-02-28T10:57:51.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-02-28T10:57:51.121ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-02-28T10:57:51.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296" } file = sled-storage/src/manager.rs:1431
5302025-02-28T10:57:51.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-02-28T10:57:51.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-02-28T10:57:51.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c" } file = sled-storage/src/manager.rs:1431
5332025-02-28T10:57:51.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342025-02-28T10:57:51.241ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352025-02-28T10:57:51.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone/oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8"), full_name: "oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone/oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8" } file = sled-storage/src/manager.rs:1431
5362025-02-28T10:57:51.298ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
5372025-02-28T10:57:51.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-02-28T10:57:51.299ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-02-28T10:57:51.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2" } file = sled-storage/src/manager.rs:1431
5402025-02-28T10:57:51.360ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-02-28T10:57:51.361ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-02-28T10:57:51.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258" } file = sled-storage/src/manager.rs:1431
5432025-02-28T10:57:51.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-02-28T10:57:51.420ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-02-28T10:57:51.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crucible" } file = sled-storage/src/manager.rs:1431
5462025-02-28T10:57:51.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-02-28T10:57:51.467ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-02-28T10:57:51.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea" } file = sled-storage/src/manager.rs:1431
5492025-02-28T10:57:51.528ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-02-28T10:57:51.528ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-02-28T10:57:51.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone/oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c"), full_name: "oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone/oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c" } file = sled-storage/src/manager.rs:1431
5522025-02-28T10:57:51.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-02-28T10:57:51.587ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5542025-02-28T10:57:51.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c223d649-aefc-4563-b832-624daf4863fe/crypt/zone"), full_name: "oxp_c223d649-aefc-4563-b832-624daf4863fe/crypt/zone" } file = sled-storage/src/manager.rs:1431
5552025-02-28T10:57:51.617ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-02-28T10:57:51.617ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-02-28T10:57:51.617ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone" } file = sled-storage/src/manager.rs:1431
5582025-02-28T10:57:51.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-02-28T10:57:51.645ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5602025-02-28T10:57:51.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone"), full_name: "oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5612025-02-28T10:57:51.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-02-28T10:57:51.673ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5632025-02-28T10:57:51.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/debug"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/debug" } file = sled-storage/src/manager.rs:1431
5642025-02-28T10:57:51.702ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-02-28T10:57:51.702ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-02-28T10:57:51.702ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crucible" } file = sled-storage/src/manager.rs:1431
5672025-02-28T10:57:51.751ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-02-28T10:57:51.751ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5692025-02-28T10:57:51.751ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone"), full_name: "oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone" } file = sled-storage/src/manager.rs:1431
5702025-02-28T10:57:51.780ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-02-28T10:57:51.781ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722025-02-28T10:57:51.781ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone/oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4" } file = sled-storage/src/manager.rs:1431
5732025-02-28T10:57:51.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-02-28T10:57:51.841ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-02-28T10:57:51.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5762025-02-28T10:57:51.890ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-02-28T10:57:51.890ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-02-28T10:57:51.890ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c" } file = sled-storage/src/manager.rs:1431
5792025-02-28T10:57:51.947ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-02-28T10:57:51.947ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5812025-02-28T10:57:51.947ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/debug"), full_name: "oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/debug" } file = sled-storage/src/manager.rs:1431
5822025-02-28T10:57:51.975ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-02-28T10:57:51.975ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-02-28T10:57:51.975ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a" } file = sled-storage/src/manager.rs:1431
5852025-02-28T10:57:52.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-02-28T10:57:52.034ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-02-28T10:57:52.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5882025-02-28T10:57:52.084ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-02-28T10:57:52.084ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-02-28T10:57:52.084ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5912025-02-28T10:57:52.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-02-28T10:57:52.134ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-02-28T10:57:52.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5942025-02-28T10:57:52.183ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-02-28T10:57:52.184ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5962025-02-28T10:57:52.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/debug"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5972025-02-28T10:57:52.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-02-28T10:57:52.212ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-02-28T10:57:52.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b" } file = sled-storage/src/manager.rs:1431
6002025-02-28T10:57:52.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-02-28T10:57:52.272ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-02-28T10:57:52.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone/oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16"), full_name: "oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/zone/oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16" } file = sled-storage/src/manager.rs:1431
6032025-02-28T10:57:52.300ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
6042025-02-28T10:57:52.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-02-28T10:57:52.331ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-02-28T10:57:52.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crucible" } file = sled-storage/src/manager.rs:1431
6072025-02-28T10:57:52.381ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-02-28T10:57:52.381ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-02-28T10:57:52.381ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone/oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1" } file = sled-storage/src/manager.rs:1431
6102025-02-28T10:57:52.441ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-02-28T10:57:52.441ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6122025-02-28T10:57:52.441ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone"), full_name: "oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6132025-02-28T10:57:52.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-02-28T10:57:52.471ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-02-28T10:57:52.471ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6162025-02-28T10:57:52.520ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-02-28T10:57:52.520ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-02-28T10:57:52.520ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6192025-02-28T10:57:52.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-02-28T10:57:52.571ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-02-28T10:57:52.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4" } file = sled-storage/src/manager.rs:1431
6222025-02-28T10:57:52.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-02-28T10:57:52.630ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6242025-02-28T10:57:52.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone"), full_name: "oxp_3c8d4110-32ba-46e1-8821-6881348da454/crypt/zone" } file = sled-storage/src/manager.rs:1431
6252025-02-28T10:57:52.660ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-02-28T10:57:52.660ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-02-28T10:57:52.660ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6282025-02-28T10:57:52.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-02-28T10:57:52.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-02-28T10:57:52.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c223d649-aefc-4563-b832-624daf4863fe/crucible" } file = sled-storage/src/manager.rs:1431
6312025-02-28T10:57:52.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-02-28T10:57:52.757ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332025-02-28T10:57:52.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone"), full_name: "oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crypt/zone" } file = sled-storage/src/manager.rs:1431
6342025-02-28T10:57:52.787ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-02-28T10:57:52.787ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-02-28T10:57:52.787ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474"), full_name: "oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crypt/zone/oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474" } file = sled-storage/src/manager.rs:1431
6372025-02-28T10:57:52.848ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-02-28T10:57:52.848ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-02-28T10:57:52.848ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crucible" } file = sled-storage/src/manager.rs:1431
6402025-02-28T10:57:52.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-02-28T10:57:52.896ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6422025-02-28T10:57:52.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/debug"), full_name: "oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6432025-02-28T10:57:52.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-02-28T10:57:52.926ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-02-28T10:57:52.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80"), full_name: "oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/zone/oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80" } file = sled-storage/src/manager.rs:1431
6462025-02-28T10:57:52.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-02-28T10:57:52.991ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-02-28T10:57:52.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone/oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c"), full_name: "oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/zone/oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c" } file = sled-storage/src/manager.rs:1431
6492025-02-28T10:57:53.052ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-02-28T10:57:53.053ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-02-28T10:57:53.053ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
6522025-02-28T10:57:53.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3209559 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62988 req_id = 462e3b6a-fc3a-4f81-b3f2-9544d4634f1e response_code = 200 uri = /datasets
6532025-02-28T10:57:53.085ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7506f7b9-22bf-424e-b97d-85956f7ce85b (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 543555ea-3364-4076-9e30-9af1ac37a3f1 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36c10864-9124-4f42-95e9-1c0fbd0ac298 (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542025-02-28T10:57:53.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36103
6552025-02-28T10:57:53.085ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6562025-02-28T10:57:53.085ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572025-02-28T10:57:53.094ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-02-28T10:57:53.094ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-02-28T10:57:53.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-02-28T10:57:53.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-02-28T10:57:53.112ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-02-28T10:57:53.112ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:188
6632025-02-28T10:57:53.112ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-02-28T10:57:53.112ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6652025-02-28T10:57:53.112ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-02-28T10:57:53.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-02-28T10:57:53.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-02-28T10:57:53.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-02-28T10:57:53.209ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b file = illumos-utils/src/zone.rs:325
6702025-02-28T10:57:53.212ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1 file = illumos-utils/src/zone.rs:325
6712025-02-28T10:57:53.216ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298 file = illumos-utils/src/zone.rs:325
6722025-02-28T10:57:53.228ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b file = illumos-utils/src/zone.rs:363
6732025-02-28T10:57:53.233ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1 file = illumos-utils/src/zone.rs:363
6742025-02-28T10:57:53.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298 file = illumos-utils/src/zone.rs:363
6752025-02-28T10:57:53.302ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
6762025-02-28T10:57:54.304ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/probe_manager.rs:238 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
6772025-02-28T10:57:54.950ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-02-28T10:57:54.950ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792025-02-28T10:57:54.950ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
6802025-02-28T10:57:55.439ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-02-28T10:57:55.919ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822025-02-28T10:57:55.919ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-02-28T10:57:55.919ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842025-02-28T10:57:55.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 43.630445ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
6852025-02-28T10:57:55.927ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
6862025-02-28T10:57:55.931ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
6872025-02-28T10:57:55.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 115.070572ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
6882025-02-28T10:57:56.051ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 29.996426ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
6892025-02-28T10:57:56.061ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 28.340529ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
6902025-02-28T10:57:56.077ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
6912025-02-28T10:57:56.077ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
6922025-02-28T10:57:56.084ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
6932025-02-28T10:57:56.084ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
6942025-02-28T10:57:56.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 147.737416ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
6952025-02-28T10:57:56.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 92.188217ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
6962025-02-28T10:57:56.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 260.5761ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
6972025-02-28T10:57:56.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 219.975183ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
6982025-02-28T10:57:56.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11354864052133583830 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
6992025-02-28T10:57:56.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10899269961859961040 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
7002025-02-28T10:57:56.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 192.649924ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7012025-02-28T10:57:56.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 352.410285ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7022025-02-28T10:57:56.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 362.048519ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7032025-02-28T10:57:56.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 203.20922ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7042025-02-28T10:57:56.596ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
7052025-02-28T10:57:56.596ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
7062025-02-28T10:57:56.653ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
7072025-02-28T10:57:56.653ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
7082025-02-28T10:57:56.714ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
7092025-02-28T10:57:56.714ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
7102025-02-28T10:57:56.735ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
7112025-02-28T10:57:56.736ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
7122025-02-28T10:57:56.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 1.100279563s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7132025-02-28T10:57:56.779ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 709.803795ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7142025-02-28T10:57:56.818ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
7152025-02-28T10:57:56.818ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
7162025-02-28T10:57:56.888ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4944121016667480812 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
7172025-02-28T10:57:56.888ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4289814308619955082 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
7182025-02-28T10:57:56.910ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7192025-02-28T10:57:56.910ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7202025-02-28T10:57:56.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 1.112556213s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7212025-02-28T10:57:57.006ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7222025-02-28T10:57:57.006ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7232025-02-28T10:57:57.047ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e34399da-90ab-4780-9b78-9879d23c2d5f) file = sled-agent/src/nexus.rs:530 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
7242025-02-28T10:57:57.048ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7252025-02-28T10:57:57.085ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7262025-02-28T10:57:57.085ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7272025-02-28T10:57:57.085ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7282025-02-28T10:57:57.085ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7292025-02-28T10:57:57.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7302025-02-28T10:57:57.177ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7312025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7322025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7332025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7342025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7352025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7362025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7372025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7382025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7392025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7402025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7412025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7422025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7432025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7442025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7452025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7462025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7472025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7482025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7492025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7502025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7512025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7522025-02-28T10:57:57.177ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7532025-02-28T10:57:57.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 1.485786978s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7542025-02-28T10:57:57.871ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 1.426328779s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7552025-02-28T10:57:58.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 577.020099ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7562025-02-28T10:57:58.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 1.46672912s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7572025-02-28T10:57:58.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 1.391899906s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7582025-02-28T10:57:59.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 674.732675ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7592025-02-28T10:57:59.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 636.934038ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7602025-02-28T10:58:00.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 606.866522ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7612025-02-28T10:58:00.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298") failed: Property not found. retry in 1.05846274s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7622025-02-28T10:58:00.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b") failed: Property not found. retry in 868.991965ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7632025-02-28T10:58:00.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1") failed: Property not found. retry in 680.026965ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7642025-02-28T10:58:01.522ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_7506f7b9-22bf-424e-b97d-85956f7ce85b
7652025-02-28T10:58:01.522ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_543555ea-3364-4076-9e30-9af1ac37a3f1
7662025-02-28T10:58:01.522ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_36c10864-9124-4f42-95e9-1c0fbd0ac298
7672025-02-28T10:58:01.522ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-02-28T10:58:01.523ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-02-28T10:58:01.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8437780 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36103 req_id = 52ecbe6f-ec6c-4379-b3d2-77525cebda67 response_code = 204 uri = /omicron-zones
7702025-02-28T10:58:01.525ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-02-28T10:58:01.714ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 93.195677ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7722025-02-28T10:58:01.832ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-02-28T10:58:01.919ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 52.506399ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7742025-02-28T10:58:01.972ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 66.111635ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7752025-02-28T10:58:02.057ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762025-02-28T10:58:02.111ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7772025-02-28T10:58:02.111ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7782025-02-28T10:58:02.142ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7792025-02-28T10:58:02.143ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7802025-02-28T10:58:02.143ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7812025-02-28T10:58:02.172ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7506f7b9-22bf-424e-b97d-85956f7ce85b (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 543555ea-3364-4076-9e30-9af1ac37a3f1 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36c10864-9124-4f42-95e9-1c0fbd0ac298 (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7640d5bb-e3a7-42fa-afb4-59760f3ec684, kind: Service { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c }, name: Name("ntp-a6b22edf-2860-4551-9bee-bf0d6f351a5c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 244])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7822025-02-28T10:58:02.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58804
7832025-02-28T10:58:02.173ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7842025-02-28T10:58:02.173ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852025-02-28T10:58:02.184ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7862025-02-28T10:58:02.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7872025-02-28T10:58:02.195ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7882025-02-28T10:58:02.195ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7892025-02-28T10:58:02.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902025-02-28T10:58:02.204ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
7912025-02-28T10:58:02.204ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
7922025-02-28T10:58:02.204ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7932025-02-28T10:58:02.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942025-02-28T10:58:02.215ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7952025-02-28T10:58:02.247ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7962025-02-28T10:58:02.248ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7972025-02-28T10:58:02.248ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7982025-02-28T10:58:02.278ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 201, 244]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7992025-02-28T10:58:02.278ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
8002025-02-28T10:58:02.278ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
8012025-02-28T10:58:02.278ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8022025-02-28T10:58:02.279ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8032025-02-28T10:58:02.279ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8042025-02-28T10:58:02.302ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c file = illumos-utils/src/zone.rs:325
8052025-02-28T10:58:02.320ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c file = illumos-utils/src/zone.rs:363
8062025-02-28T10:58:02.990ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8072025-02-28T10:58:02.992ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8082025-02-28T10:58:03.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 68.494808ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8092025-02-28T10:58:03.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 147.357781ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8102025-02-28T10:58:03.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 153.925891ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8112025-02-28T10:58:03.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 357.709033ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8122025-02-28T10:58:03.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 923.431136ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8132025-02-28T10:58:04.881ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 1.261728784s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8142025-02-28T10:58:06.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 727.155015ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8152025-02-28T10:58:06.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11354864052133583830 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8162025-02-28T10:58:06.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10899269961859961040 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8172025-02-28T10:58:06.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c") failed: Property not found. retry in 997.035607ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8182025-02-28T10:58:06.890ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4944121016667480812 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8192025-02-28T10:58:06.890ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4289814308619955082 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8202025-02-28T10:58:07.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c
8212025-02-28T10:58:07.907ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222025-02-28T10:58:07.908ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232025-02-28T10:58:07.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5735384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58804 req_id = b54893a3-9b4d-4962-aaa5-57f239b80497 response_code = 204 uri = /omicron-zones
8242025-02-28T10:58:07.910ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8252025-02-28T10:58:07.940ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-02-28T10:58:07.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45733
8272025-02-28T10:58:07.952ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8282025-02-28T10:58:07.952ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 11146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45733 req_id = ef0e71e9-1251-4c01-953f-ba6825444a8b response_code = 500 uri = /timesync
8292025-02-28T10:58:07.954ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302025-02-28T10:58:08.108ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8312025-02-28T10:58:08.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39087
8322025-02-28T10:58:11.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12241121112250643274 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8332025-02-28T10:58:11.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15958083551244204828 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8342025-02-28T10:58:11.524ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 758397342062443854 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8352025-02-28T10:58:12.118ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8362025-02-28T10:58:12.118ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39087 req_id = 72a2f790-1c9b-40d1-acbb-efe417f14af3 response_code = 500 uri = /timesync
8372025-02-28T10:58:12.121ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-02-28T10:58:12.263ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392025-02-28T10:58:12.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52499
8402025-02-28T10:58:12.272ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8412025-02-28T10:58:12.272ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8360 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52499 req_id = 855ace4b-f091-4943-a333-11226860f769 response_code = 500 uri = /timesync
8422025-02-28T10:58:12.275ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432025-02-28T10:58:12.493ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442025-02-28T10:58:12.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44339
8452025-02-28T10:58:12.501ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a6b22edf-2860-4551-9bee-bf0d6f351a5c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8462025-02-28T10:58:12.501ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44339 req_id = bb9a8ba8-fea2-458d-ac34-e748fe84dc23 response_code = 500 uri = /timesync
8472025-02-28T10:58:12.504ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-02-28T10:58:12.789ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-02-28T10:58:12.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48907
8502025-02-28T10:58:13.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1008236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48907 req_id = 9c9aa338-f7c6-4d64-8a43-c9c8cc9d378d response_code = 200 uri = /timesync
8512025-02-28T10:58:13.800ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8522025-02-28T10:58:13.800ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-02-28T10:58:13.964ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-02-28T10:58:13.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44667
8552025-02-28T10:58:13.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44667 req_id = 7f217ba1-ad07-4bdf-b05b-3c6495d24042 response_code = 200 uri = /timesync
8562025-02-28T10:58:13.975ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-02-28T10:58:13.975ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-02-28T10:58:14.154ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-02-28T10:58:14.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58135
8602025-02-28T10:58:14.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58135 req_id = 9ca8a2e7-2a90-4864-b752-3c705beded98 response_code = 200 uri = /timesync
8612025-02-28T10:58:14.166ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-02-28T10:58:14.166ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-02-28T10:58:14.499ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-02-28T10:58:14.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56270
8652025-02-28T10:58:14.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56270 req_id = 914b2174-047a-43e0-8535-09c78fd169ba response_code = 200 uri = /timesync
8662025-02-28T10:58:14.510ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8672025-02-28T10:58:14.510ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-02-28T10:58:15.013ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-02-28T10:58:15.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43078
8702025-02-28T10:58:15.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43078 req_id = fc96c454-a61d-4259-a79d-1557f4ff89f2 response_code = 200 uri = /timesync
8712025-02-28T10:58:15.025ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8722025-02-28T10:58:15.025ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-02-28T10:58:15.243ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742025-02-28T10:58:15.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63153
8752025-02-28T10:58:15.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63153 req_id = e5d3a9e1-c396-460a-867a-7ad4d9fe9881 response_code = 200 uri = /timesync
8762025-02-28T10:58:15.254ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8772025-02-28T10:58:15.254ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782025-02-28T10:58:15.885ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792025-02-28T10:58:15.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53914
8802025-02-28T10:58:15.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7980 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53914 req_id = 1ec58f15-c49f-4f6a-aafb-3f9a6f9796ba response_code = 200 uri = /timesync
8812025-02-28T10:58:15.896ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.054016627 } file = sled-agent/src/rack_setup/service.rs:743
8822025-02-28T10:58:15.896ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832025-02-28T10:58:15.911ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11354864052133583830 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8842025-02-28T10:58:15.912ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10899269961859961040 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8852025-02-28T10:58:16.371ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862025-02-28T10:58:16.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63234
8872025-02-28T10:58:16.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63234 req_id = 5017fd0d-adbc-4c6f-b1b7-359be6ae4409 response_code = 200 uri = /timesync
8882025-02-28T10:58:16.382ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.052701663 } file = sled-agent/src/rack_setup/service.rs:743
8892025-02-28T10:58:16.382ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902025-02-28T10:58:16.505ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4944121016667480812 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8912025-02-28T10:58:16.505ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4289814308619955082 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8922025-02-28T10:58:17.399ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932025-02-28T10:58:17.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56662
8942025-02-28T10:58:17.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56662 req_id = 097d4dc2-abfd-41b6-b17a-8efdd7414114 response_code = 200 uri = /timesync
8952025-02-28T10:58:17.411ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.056208946 } file = sled-agent/src/rack_setup/service.rs:743
8962025-02-28T10:58:17.411ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972025-02-28T10:58:17.525ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18248266572348146169 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8982025-02-28T10:58:17.525ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6954352165083891806 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
8992025-02-28T10:58:17.910ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9002025-02-28T10:58:17.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51713
9012025-02-28T10:58:17.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8928 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51713 req_id = e278cceb-a3f7-49da-9b2a-6526e6a823b1 response_code = 200 uri = /timesync
9022025-02-28T10:58:17.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.054999907 } file = sled-agent/src/rack_setup/service.rs:743
9032025-02-28T10:58:17.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9042025-02-28T10:58:18.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052025-02-28T10:58:18.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47892
9062025-02-28T10:58:18.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47892 req_id = b6359579-72e5-4e9a-8c4f-e507e8766d28 response_code = 200 uri = /timesync
9072025-02-28T10:58:18.618ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1199255225, ip_addr: 71.123.46.185, stratum: 3, ref_time: 1740740298.0213103, correction: 0.047417063 } file = sled-agent/src/rack_setup/service.rs:743
9082025-02-28T10:58:18.618ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
9092025-02-28T10:58:18.648ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7506f7b9-22bf-424e-b97d-85956f7ce85b (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 543555ea-3364-4076-9e30-9af1ac37a3f1 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36c10864-9124-4f42-95e9-1c0fbd0ac298 (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7640d5bb-e3a7-42fa-afb4-59760f3ec684, kind: Service { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c }, name: Name("ntp-a6b22edf-2860-4551-9bee-bf0d6f351a5c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 244])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: c6582c24-10be-45df-8350-45cd55654474 (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 45551b93-1f4e-4c22-a908-c6bd3da3754c (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b1e110e0-5f9f-4267-a054-c444d5d68170 (service), filesystem_pool: Some(ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f415f04-08e3-468c-9588-877ecf198c80 (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9102025-02-28T10:58:18.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37482
9112025-02-28T10:58:18.648ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9122025-02-28T10:58:18.648ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }
9132025-02-28T10:58:18.658ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9142025-02-28T10:58:18.658ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9152025-02-28T10:58:18.668ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9162025-02-28T10:58:18.668ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9172025-02-28T10:58:18.677ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9182025-02-28T10:58:18.677ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, responder: ... }
9192025-02-28T10:58:18.687ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9202025-02-28T10:58:18.687ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9212025-02-28T10:58:18.696ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9222025-02-28T10:58:18.696ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9232025-02-28T10:58:18.705ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9242025-02-28T10:58:18.705ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9252025-02-28T10:58:18.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9262025-02-28T10:58:18.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, responder: ... }
9272025-02-28T10:58:18.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9282025-02-28T10:58:18.723ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
9292025-02-28T10:58:18.723ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
9302025-02-28T10:58:18.724ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9312025-02-28T10:58:18.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9322025-02-28T10:58:18.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9332025-02-28T10:58:18.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9342025-02-28T10:58:18.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9352025-02-28T10:58:18.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9362025-02-28T10:58:18.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9372025-02-28T10:58:18.898ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c file = illumos-utils/src/zone.rs:325
9382025-02-28T10:58:18.902ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474 file = illumos-utils/src/zone.rs:325
9392025-02-28T10:58:18.906ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80 file = illumos-utils/src/zone.rs:325
9402025-02-28T10:58:18.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170 file = illumos-utils/src/zone.rs:325
9412025-02-28T10:58:18.915ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5 file = illumos-utils/src/zone.rs:325
9422025-02-28T10:58:18.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c file = illumos-utils/src/zone.rs:363
9432025-02-28T10:58:18.924ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474 file = illumos-utils/src/zone.rs:363
9442025-02-28T10:58:18.928ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80 file = illumos-utils/src/zone.rs:363
9452025-02-28T10:58:18.933ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170 file = illumos-utils/src/zone.rs:363
9462025-02-28T10:58:18.938ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5 file = illumos-utils/src/zone.rs:363
9472025-02-28T10:58:21.136ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 163.84829ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
9482025-02-28T10:58:22.585ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c6582c24-10be-45df-8350-45cd55654474'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9492025-02-28T10:58:22.585ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9502025-02-28T10:58:22.624ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4f415f04-08e3-468c-9588-877ecf198c80'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9512025-02-28T10:58:22.624ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9522025-02-28T10:58:22.721ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9532025-02-28T10:58:22.728ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9542025-02-28T10:58:22.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 59.234068ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9552025-02-28T10:58:22.776ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='45551b93-1f4e-4c22-a908-c6bd3da3754c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9562025-02-28T10:58:22.777ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9572025-02-28T10:58:22.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 63.859088ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9582025-02-28T10:58:22.807ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b1e110e0-5f9f-4267-a054-c444d5d68170'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9592025-02-28T10:58:22.807ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9602025-02-28T10:58:22.856ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 107.162883ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9612025-02-28T10:58:22.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 53.162276ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9622025-02-28T10:58:22.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 266.362254ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9632025-02-28T10:58:23.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 132.501321ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9642025-02-28T10:58:23.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 35.951978ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9652025-02-28T10:58:23.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 45.828068ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9662025-02-28T10:58:23.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 83.613218ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9672025-02-28T10:58:23.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 63.334968ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9682025-02-28T10:58:23.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 60.657105ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9692025-02-28T10:58:23.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 409.979197ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9702025-02-28T10:58:23.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 89.922571ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9712025-02-28T10:58:23.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 299.490438ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9722025-02-28T10:58:23.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 143.189686ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9732025-02-28T10:58:23.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 395.20338ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9742025-02-28T10:58:23.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 152.045631ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9752025-02-28T10:58:23.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 218.459809ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9762025-02-28T10:58:23.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 485.132504ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9772025-02-28T10:58:23.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 535.809977ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9782025-02-28T10:58:23.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 515.675759ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9792025-02-28T10:58:23.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 676.268364ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9802025-02-28T10:58:23.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 747.263086ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9812025-02-28T10:58:24.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 533.342343ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9822025-02-28T10:58:24.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 896.937517ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9832025-02-28T10:58:24.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 1.05874337s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9842025-02-28T10:58:24.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 705.807394ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9852025-02-28T10:58:24.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 954.866716ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9862025-02-28T10:58:24.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 891.749538ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9872025-02-28T10:58:25.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 1.323265404s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9882025-02-28T10:58:25.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 516.979558ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9892025-02-28T10:58:25.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 657.504203ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9902025-02-28T10:58:25.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 668.151604ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9912025-02-28T10:58:25.552ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 930.984016ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9922025-02-28T10:58:25.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 1.181577939s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
9932025-02-28T10:58:25.924ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 956.138592ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
9942025-02-28T10:58:26.056ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45299
9952025-02-28T10:58:26.056ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45299 req_id = c9d5b96e-f96d-4fab-8c68-35ef4e4cefc6 response_code = 200 uri = /baseboard
9962025-02-28T10:58:26.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 883.521856ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
9972025-02-28T10:58:26.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 1.22770832s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
9982025-02-28T10:58:26.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 1.329078484s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
9992025-02-28T10:58:26.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 673.115575ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10002025-02-28T10:58:26.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 712.712502ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10012025-02-28T10:58:27.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 1.487982354s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10022025-02-28T10:58:27.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 741.620795ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10032025-02-28T10:58:27.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 671.139028ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10042025-02-28T10:58:27.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 586.913595ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10052025-02-28T10:58:27.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 866.163577ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10062025-02-28T10:58:28.263ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 1.002156282s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10072025-02-28T10:58:28.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 1.109940708s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10082025-02-28T10:58:28.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 1.039379882s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10092025-02-28T10:58:28.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 969.560647ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10102025-02-28T10:58:28.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 777.676895ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10112025-02-28T10:58:29.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 1.141599939s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10122025-02-28T10:58:29.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 817.135371ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10132025-02-28T10:58:29.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 1.351160701s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10142025-02-28T10:58:29.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 874.396389ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10152025-02-28T10:58:29.610ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 521.510028ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10162025-02-28T10:58:30.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 806.731215ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10172025-02-28T10:58:30.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 1.247894394s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10182025-02-28T10:58:30.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 701.856712ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10192025-02-28T10:58:30.433ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 608.388598ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10202025-02-28T10:58:30.784ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 502.555865ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10212025-02-28T10:58:30.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 505.931266ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10222025-02-28T10:58:31.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5") failed: Property not found. retry in 1.2120661s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10232025-02-28T10:58:31.104ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170") failed: Property not found. retry in 1.496730626s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10242025-02-28T10:58:31.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474") failed: Property not found. retry in 1.181237102s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10252025-02-28T10:58:31.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c") failed: Property not found. retry in 941.729614ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10262025-02-28T10:58:31.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80") failed: Property not found. retry in 857.563164ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10272025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c
10282025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_c6582c24-10be-45df-8350-45cd55654474
10292025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_4f415f04-08e3-468c-9588-877ecf198c80
10302025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_b1e110e0-5f9f-4267-a054-c444d5d68170
10312025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5
10322025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10332025-02-28T10:58:32.628ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10342025-02-28T10:58:32.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 13941576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37482 req_id = 9fc35ac5-4187-4e64-b726-fcb1aaf81717 response_code = 204 uri = /omicron-zones
10352025-02-28T10:58:32.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44232
10362025-02-28T10:58:32.692ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = 90238b77-0d37-45da-9f39-97f8ed3cf167 response_code = 500 uri = /cockroachdb
10372025-02-28T10:58:32.693ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "90238b77-0d37-45da-9f39-97f8ed3cf167", "content-length": "124", "date": "Fri, 28 Feb 2025 10:58:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "90238b77-0d37-45da-9f39-97f8ed3cf167" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 76.397816ms
10382025-02-28T10:58:32.805ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 33418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = 86acc361-ae4c-4b4d-84da-2beb0449c76b response_code = 500 uri = /cockroachdb
10392025-02-28T10:58:32.805ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "86acc361-ae4c-4b4d-84da-2beb0449c76b", "content-length": "124", "date": "Fri, 28 Feb 2025 10:58:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "86acc361-ae4c-4b4d-84da-2beb0449c76b" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 174.861589ms
10402025-02-28T10:58:33.013ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 31420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = 9e51d03e-e543-4e66-bc07-62c522c11f95 response_code = 500 uri = /cockroachdb
10412025-02-28T10:58:33.013ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9e51d03e-e543-4e66-bc07-62c522c11f95", "content-length": "124", "date": "Fri, 28 Feb 2025 10:58:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9e51d03e-e543-4e66-bc07-62c522c11f95" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 207.937986ms
10422025-02-28T10:58:33.250ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = b7b161e7-4f33-4623-8f90-a8e5f4608c23 response_code = 500 uri = /cockroachdb
10432025-02-28T10:58:33.250ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b7b161e7-4f33-4623-8f90-a8e5f4608c23", "content-length": "124", "date": "Fri, 28 Feb 2025 10:58:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b7b161e7-4f33-4623-8f90-a8e5f4608c23" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 186.808211ms
10442025-02-28T10:58:33.465ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45551b93-1f4e-4c22-a908-c6bd3da3754c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26436 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = 8f19778c-7654-4f7f-9088-246a72e6739e response_code = 500 uri = /cockroachdb
10452025-02-28T10:58:33.465ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8f19778c-7654-4f7f-9088-246a72e6739e", "content-length": "124", "date": "Fri, 28 Feb 2025 10:58:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8f19778c-7654-4f7f-9088-246a72e6739e" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 277.898046ms
10462025-02-28T10:58:33.775ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3852
10472025-02-28T10:59:03.074ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
10482025-02-28T10:59:13.294ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
10492025-02-28T10:59:13.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39543646 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44232 req_id = f096f3d8-de53-4af8-956e-a4fc7fc81f12 response_code = 204 uri = /cockroachdb
10502025-02-28T10:59:13.297ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34213
10512025-02-28T10:59:13.306ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 420.214126ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
10522025-02-28T10:59:13.339ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7506f7b9-22bf-424e-b97d-85956f7ce85b (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 543555ea-3364-4076-9e30-9af1ac37a3f1 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36c10864-9124-4f42-95e9-1c0fbd0ac298 (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7640d5bb-e3a7-42fa-afb4-59760f3ec684, kind: Service { id: a6b22edf-2860-4551-9bee-bf0d6f351a5c }, name: Name("ntp-a6b22edf-2860-4551-9bee-bf0d6f351a5c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 244])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: c6582c24-10be-45df-8350-45cd55654474 (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ab2ebee1-a27e-4e8f-a443-4e5afaaab6e5 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 45551b93-1f4e-4c22-a908-c6bd3da3754c (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b1e110e0-5f9f-4267-a054-c444d5d68170 (service), filesystem_pool: Some(ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f415f04-08e3-468c-9588-877ecf198c80 (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0af75e4f-3314-468e-b1a8-ef13556995ea (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 80b2977d-cb89-4acf-9305-fe891d3444ad (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 74f1547b-a833-4952-b80e-4986ebf8427a (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 (service), filesystem_pool: Some(ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: e48a4f46-1a6f-418f-a5a7-e97c705cc065 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1b1b9951-d4a4-431f-8c93-98d541171ff4 (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c (service), filesystem_pool: Some(ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 252b67b1-e358-449e-b698-30f1c8152fa8 (service), filesystem_pool: Some(ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 59455d04-0b86-4c6a-9736-5dcecd2f7258 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 9f9031b2-6cfc-44f9-b068-e81317a23296 (service), filesystem_pool: Some(ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3a7a56e4-5d64-4d44-a29b-d2da57350070 (service), filesystem_pool: Some(ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 481da4b9-37c0-46ea-8223-c760924e0da4 (service), filesystem_pool: Some(ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 04be91ff-b46f-4845-aa1f-ae07b47fbd16 (service), filesystem_pool: Some(ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3c64ab0c-453f-4806-86d4-4483cc9fae5a (service), filesystem_pool: Some(ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 31edf858-0db0-4d38-ab9b-0a2ffb387331 (service), filesystem_pool: Some(ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0d7a7f54-d72b-4c24-a750-d5e213a5095a (service), filesystem_pool: Some(ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 6150b424-a5da-45ed-ad5b-dbd3d99de55c (service), filesystem_pool: Some(ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: eabd8971-b23c-41e0-9293-50688da518e3 (service), filesystem_pool: Some(ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10532025-02-28T10:59:13.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52970
10542025-02-28T10:59:13.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-02-28T10:59:13.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: InternalDns }, responder: ... }
10562025-02-28T10:59:13.357ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-02-28T10:59:13.357ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10582025-02-28T10:59:13.368ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10592025-02-28T10:59:13.368ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10602025-02-28T10:59:13.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10612025-02-28T10:59:13.380ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Cockroach }, responder: ... }
10622025-02-28T10:59:13.390ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10632025-02-28T10:59:13.390ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10642025-02-28T10:59:13.400ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10652025-02-28T10:59:13.400ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10662025-02-28T10:59:13.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-02-28T10:59:13.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10682025-02-28T10:59:13.420ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-02-28T10:59:13.420ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10702025-02-28T10:59:13.431ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-02-28T10:59:13.431ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10722025-02-28T10:59:13.445ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-02-28T10:59:13.445ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10742025-02-28T10:59:13.455ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-02-28T10:59:13.455ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10762025-02-28T10:59:13.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-02-28T10:59:13.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, kind: Crucible }, responder: ... }
10782025-02-28T10:59:13.484ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-02-28T10:59:13.484ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, kind: Crucible }, responder: ... }
10802025-02-28T10:59:13.494ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-02-28T10:59:13.494ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, kind: Crucible }, responder: ... }
10822025-02-28T10:59:13.505ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-02-28T10:59:13.505ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, kind: Crucible }, responder: ... }
10842025-02-28T10:59:13.516ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-02-28T10:59:13.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, kind: Crucible }, responder: ... }
10862025-02-28T10:59:13.528ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-02-28T10:59:13.528ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, kind: Crucible }, responder: ... }
10882025-02-28T10:59:13.541ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10892025-02-28T10:59:13.541ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10902025-02-28T10:59:13.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10912025-02-28T10:59:13.554ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, kind: Crucible }, responder: ... }
10922025-02-28T10:59:13.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10932025-02-28T10:59:13.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, kind: Crucible }, responder: ... }
10942025-02-28T10:59:13.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-02-28T10:59:13.578ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
10962025-02-28T10:59:13.579ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
10972025-02-28T10:59:13.579ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
10982025-02-28T10:59:13.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-02-28T10:59:13.712ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11002025-02-28T10:59:13.754ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11012025-02-28T10:59:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-02-28T10:59:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11032025-02-28T10:59:13.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11042025-02-28T10:59:13.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11052025-02-28T10:59:13.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11062025-02-28T10:59:13.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11072025-02-28T10:59:13.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11082025-02-28T10:59:13.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092025-02-28T10:59:13.988ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11102025-02-28T10:59:14.029ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11112025-02-28T10:59:14.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11122025-02-28T10:59:14.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-02-28T10:59:14.060ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11142025-02-28T10:59:14.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11152025-02-28T10:59:14.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11162025-02-28T10:59:14.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11172025-02-28T10:59:14.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182025-02-28T10:59:14.061ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296 file = illumos-utils/src/zone.rs:325
11192025-02-28T10:59:14.066ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065 file = illumos-utils/src/zone.rs:325
11202025-02-28T10:59:14.071ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331 file = illumos-utils/src/zone.rs:325
11212025-02-28T10:59:14.077ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3 file = illumos-utils/src/zone.rs:325
11222025-02-28T10:59:14.082ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a file = illumos-utils/src/zone.rs:325
11232025-02-28T10:59:14.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4 file = illumos-utils/src/zone.rs:325
11242025-02-28T10:59:14.094ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c file = illumos-utils/src/zone.rs:325
11252025-02-28T10:59:14.100ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a file = illumos-utils/src/zone.rs:325
11262025-02-28T10:59:14.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296 file = illumos-utils/src/zone.rs:363
11272025-02-28T10:59:14.243ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065 file = illumos-utils/src/zone.rs:363
11282025-02-28T10:59:14.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331 file = illumos-utils/src/zone.rs:363
11292025-02-28T10:59:14.253ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3 file = illumos-utils/src/zone.rs:363
11302025-02-28T10:59:14.258ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a file = illumos-utils/src/zone.rs:363
11312025-02-28T10:59:14.263ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4 file = illumos-utils/src/zone.rs:363
11322025-02-28T10:59:14.267ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c file = illumos-utils/src/zone.rs:363
11332025-02-28T10:59:14.272ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a file = illumos-utils/src/zone.rs:363
11342025-02-28T10:59:14.278ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070 file = illumos-utils/src/zone.rs:325
11352025-02-28T10:59:14.283ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16 file = illumos-utils/src/zone.rs:325
11362025-02-28T10:59:14.289ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c file = illumos-utils/src/zone.rs:325
11372025-02-28T10:59:14.294ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258 file = illumos-utils/src/zone.rs:325
11382025-02-28T10:59:14.299ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8 file = illumos-utils/src/zone.rs:325
11392025-02-28T10:59:14.306ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4 file = illumos-utils/src/zone.rs:325
11402025-02-28T10:59:14.370ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11412025-02-28T10:59:14.370ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070 file = illumos-utils/src/zone.rs:363
11422025-02-28T10:59:14.381ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16 file = illumos-utils/src/zone.rs:363
11432025-02-28T10:59:14.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c file = illumos-utils/src/zone.rs:363
11442025-02-28T10:59:14.415ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258 file = illumos-utils/src/zone.rs:363
11452025-02-28T10:59:14.441ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8 file = illumos-utils/src/zone.rs:363
11462025-02-28T10:59:14.450ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4 file = illumos-utils/src/zone.rs:363
11472025-02-28T10:59:14.519ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11482025-02-28T10:59:14.576ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11492025-02-28T10:59:14.638ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11502025-02-28T10:59:14.701ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11512025-02-28T10:59:14.704ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11522025-02-28T10:59:14.704ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11532025-02-28T10:59:14.762ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 225, 246]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11542025-02-28T10:59:14.762ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11552025-02-28T10:59:14.764ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11562025-02-28T10:59:14.764ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11572025-02-28T10:59:14.818ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 178, 4]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11582025-02-28T10:59:14.818ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11592025-02-28T10:59:14.820ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11602025-02-28T10:59:14.820ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11612025-02-28T10:59:14.875ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 178, 202]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11622025-02-28T10:59:14.875ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11632025-02-28T10:59:14.877ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11642025-02-28T10:59:14.877ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11652025-02-28T10:59:14.933ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 224, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11662025-02-28T10:59:14.933ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11672025-02-28T10:59:14.934ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11682025-02-28T10:59:14.934ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11692025-02-28T10:59:14.990ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 214, 11]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11702025-02-28T10:59:14.990ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11712025-02-28T10:59:14.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11722025-02-28T10:59:14.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11732025-02-28T10:59:14.990ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11742025-02-28T10:59:14.990ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11752025-02-28T10:59:14.991ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11762025-02-28T10:59:14.991ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11772025-02-28T10:59:14.991ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11782025-02-28T10:59:14.991ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11792025-02-28T10:59:14.994ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11802025-02-28T10:59:14.994ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11812025-02-28T10:59:15.012ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11822025-02-28T10:59:15.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11832025-02-28T10:59:15.074ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11842025-02-28T10:59:15.077ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11852025-02-28T10:59:15.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11862025-02-28T10:59:15.081ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11872025-02-28T10:59:15.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11882025-02-28T10:59:15.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11892025-02-28T10:59:15.084ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11902025-02-28T10:59:15.259ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11912025-02-28T10:59:15.311ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea file = illumos-utils/src/zone.rs:325
11922025-02-28T10:59:15.324ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8 file = illumos-utils/src/zone.rs:325
11932025-02-28T10:59:15.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2 file = illumos-utils/src/zone.rs:325
11942025-02-28T10:59:15.351ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a file = illumos-utils/src/zone.rs:325
11952025-02-28T10:59:15.367ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad file = illumos-utils/src/zone.rs:325
11962025-02-28T10:59:15.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea file = illumos-utils/src/zone.rs:363
11972025-02-28T10:59:15.405ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8 file = illumos-utils/src/zone.rs:363
11982025-02-28T10:59:15.415ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2 file = illumos-utils/src/zone.rs:363
11992025-02-28T10:59:15.430ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a file = illumos-utils/src/zone.rs:363
12002025-02-28T10:59:15.439ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad file = illumos-utils/src/zone.rs:363
12012025-02-28T10:59:20.779ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-02-28T10:59:20.790ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12032025-02-28T10:59:20.790ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12042025-02-28T10:59:20.809ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12052025-02-28T10:59:21.024ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c080afa7-d999-4b5d-8de0-eff1a8340c3c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062025-02-28T10:59:21.024ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c223d649-aefc-4563-b832-624daf4863fe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bbcf3b70-4324-45af-a8a1-c6fe59995b92'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12072025-02-28T10:59:21.024ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12082025-02-28T10:59:21.032ZINFOSledAgent (ServiceManager): Booting oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12092025-02-28T10:59:21.039ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='76e8df90-0c39-4890-9046-6371d853c8b8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12102025-02-28T10:59:21.039ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='307e42a9-6422-48e4-afb4-ca547494fec4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12112025-02-28T10:59:21.039ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='12a97950-60b6-4f56-961f-c2619a5dc2dc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12122025-02-28T10:59:21.039ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3f968e33-26a6-4b53-b7c4-6872a5b65f57'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132025-02-28T10:59:21.040ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12142025-02-28T10:59:21.046ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12152025-02-28T10:59:21.051ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12162025-02-28T10:59:21.057ZINFOSledAgent (ServiceManager): Booting oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12172025-02-28T10:59:21.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 59.65883ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12182025-02-28T10:59:21.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 55.212088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12192025-02-28T10:59:21.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 32.985245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12202025-02-28T10:59:21.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 56.144098ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12212025-02-28T10:59:21.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 73.092076ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12222025-02-28T10:59:21.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 50.849277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12232025-02-28T10:59:21.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 66.428531ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12242025-02-28T10:59:21.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 67.48027ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12252025-02-28T10:59:21.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 117.453991ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12262025-02-28T10:59:21.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 144.777543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12272025-02-28T10:59:21.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 59.578569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12282025-02-28T10:59:21.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 75.960549ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12292025-02-28T10:59:21.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 140.181614ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12302025-02-28T10:59:21.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 59.414955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12312025-02-28T10:59:21.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 125.982465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12322025-02-28T10:59:21.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 59.766814ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12332025-02-28T10:59:22.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 215.870349ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12342025-02-28T10:59:22.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 202.443841ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12352025-02-28T10:59:22.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 293.024374ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12362025-02-28T10:59:22.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 138.830306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12372025-02-28T10:59:22.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 112.45562ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12382025-02-28T10:59:22.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 202.989ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12392025-02-28T10:59:22.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 161.822354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12402025-02-28T10:59:22.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 201.456053ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12412025-02-28T10:59:22.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 301.38112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12422025-02-28T10:59:22.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 379.213675ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12432025-02-28T10:59:22.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 545.603277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12442025-02-28T10:59:22.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 569.037155ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12452025-02-28T10:59:22.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 243.980766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12462025-02-28T10:59:22.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 294.7541ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12472025-02-28T10:59:22.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 556.261562ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12482025-02-28T10:59:22.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 576.106761ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12492025-02-28T10:59:22.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 926.553431ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12502025-02-28T10:59:22.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 863.225106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12512025-02-28T10:59:22.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 645.727298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12522025-02-28T10:59:22.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 950.69059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12532025-02-28T10:59:23.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.148403502s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12542025-02-28T10:59:23.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 943.677972ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12552025-02-28T10:59:23.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 930.68835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12562025-02-28T10:59:23.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 976.114574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12572025-02-28T10:59:23.517ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 692.728992ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12582025-02-28T10:59:23.634ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 724.008253ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12592025-02-28T10:59:23.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 875.881667ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12602025-02-28T10:59:23.829ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 877.898045ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12612025-02-28T10:59:24.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.471569031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12622025-02-28T10:59:24.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.239053238s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12632025-02-28T10:59:24.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 650.517429ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12642025-02-28T10:59:24.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 745.527191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12652025-02-28T10:59:24.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 695.623919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12662025-02-28T10:59:24.339ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672025-02-28T10:59:24.339ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12682025-02-28T10:59:24.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.363124921s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12692025-02-28T10:59:24.574ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 521.162876ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12702025-02-28T10:59:24.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 46.368767ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12712025-02-28T10:59:24.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 87.869342ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12722025-02-28T10:59:24.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.119210878s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12732025-02-28T10:59:24.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 111.073491ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12742025-02-28T10:59:24.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.08039598s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12752025-02-28T10:59:24.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 217.479715ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12762025-02-28T10:59:24.931ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 880.865486ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12772025-02-28T10:59:24.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.036416782s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12782025-02-28T10:59:25.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 984.835847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12792025-02-28T10:59:25.123ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 817.483128ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12802025-02-28T10:59:25.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.014691463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12812025-02-28T10:59:25.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.157028468s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12822025-02-28T10:59:25.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.151941572s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12832025-02-28T10:59:25.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.151449537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12842025-02-28T10:59:25.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.415877386s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
12852025-02-28T10:59:25.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 644.818059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12862025-02-28T10:59:25.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.080559165s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12872025-02-28T10:59:26.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.244087879s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12882025-02-28T10:59:26.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.006650399s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12892025-02-28T10:59:26.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 867.186428ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12902025-02-28T10:59:26.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 571.396885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12912025-02-28T10:59:26.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 789.856923ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
12922025-02-28T10:59:26.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 565.886595ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
12932025-02-28T10:59:26.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 704.403929ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
12942025-02-28T10:59:27.057ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 510.218922ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
12952025-02-28T10:59:27.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 672.552369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
12962025-02-28T10:59:27.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 605.883299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
12972025-02-28T10:59:27.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 785.831378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
12982025-02-28T10:59:27.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.319197845s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
12992025-02-28T10:59:27.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.379204536s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13002025-02-28T10:59:27.478ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.207847631s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13012025-02-28T10:59:27.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.2891163s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13022025-02-28T10:59:27.580ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 692.443192ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13032025-02-28T10:59:27.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 778.657442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13042025-02-28T10:59:27.813ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.448056709s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13052025-02-28T10:59:27.828ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.324812323s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13062025-02-28T10:59:28.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.421460361s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13072025-02-28T10:59:28.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 546.892773ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13082025-02-28T10:59:28.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 713.851783ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13092025-02-28T10:59:28.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.029800509s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13102025-02-28T10:59:28.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.296994495s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13112025-02-28T10:59:28.695ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 519.151816ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13122025-02-28T10:59:28.805ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.398850484s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
13132025-02-28T10:59:28.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.099573234s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13142025-02-28T10:59:28.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.264312683s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13152025-02-28T10:59:29.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 720.188808ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13162025-02-28T10:59:29.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.118873537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13172025-02-28T10:59:29.230ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.074757818s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13182025-02-28T10:59:29.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 578.582242ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13192025-02-28T10:59:29.513ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.007278112s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13202025-02-28T10:59:29.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 952.472036ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13212025-02-28T10:59:29.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.010737445s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13222025-02-28T10:59:29.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.183721116s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13232025-02-28T10:59:29.922ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 598.078917ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13242025-02-28T10:59:29.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.417615023s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13252025-02-28T10:59:30.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 814.989247ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13262025-02-28T10:59:30.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.456513517s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13272025-02-28T10:59:30.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 537.066037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13282025-02-28T10:59:30.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 924.143595ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13292025-02-28T10:59:30.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 746.447451ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13302025-02-28T10:59:30.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 969.781932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13312025-02-28T10:59:30.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 736.791537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13322025-02-28T10:59:30.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.467194652s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13332025-02-28T10:59:30.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 568.686692ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13342025-02-28T10:59:31.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.291849183s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13352025-02-28T10:59:31.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.388886321s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13362025-02-28T10:59:31.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.081783282s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13372025-02-28T10:59:31.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.381494896s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13382025-02-28T10:59:31.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 719.938933ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13392025-02-28T10:59:31.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 830.156832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13402025-02-28T10:59:31.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.483578616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13412025-02-28T10:59:31.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.337549695s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13422025-02-28T10:59:32.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.329978241s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13432025-02-28T10:59:32.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 818.716744ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13442025-02-28T10:59:32.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.228621673s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13452025-02-28T10:59:32.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.399097683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13462025-02-28T10:59:32.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 880.329625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13472025-02-28T10:59:32.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 505.842169ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13482025-02-28T10:59:32.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 857.833451ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13492025-02-28T10:59:33.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.039202856s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13502025-02-28T10:59:33.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.358095408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13512025-02-28T10:59:33.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 595.483606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13522025-02-28T10:59:33.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.385116302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13532025-02-28T10:59:33.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.291775113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13542025-02-28T10:59:33.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.030540689s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13552025-02-28T10:59:33.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 722.137322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13562025-02-28T10:59:33.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.120009639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13572025-02-28T10:59:33.815ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.463730864s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13582025-02-28T10:59:33.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.236746243s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13592025-02-28T10:59:34.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 859.733095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13602025-02-28T10:59:34.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.040659528s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13612025-02-28T10:59:34.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 840.795382ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13622025-02-28T10:59:34.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_191404b5-bb5f-4942-aade-4f02119d69b0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11c4e556-37c2-4c5f-b33b-32cc13b2ac38'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13632025-02-28T10:59:34.543ZINFOSledAgent (ServiceManager): Booting oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
13642025-02-28T10:59:34.552ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_198de296-2120-47e0-aaa7-ce837077a9bd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='88d017d4-618d-46ad-bd81-a06c839d1b36'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652025-02-28T10:59:34.553ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
13662025-02-28T10:59:34.581ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3c8d4110-32ba-46e1-8821-6881348da454/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c07f3ecb-af9d-419a-9446-65e07ddab403'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13672025-02-28T10:59:34.581ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
13682025-02-28T10:59:34.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 574.100191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13692025-02-28T10:59:34.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 692.269967ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13702025-02-28T10:59:34.648ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13712025-02-28T10:59:34.649ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
13722025-02-28T10:59:34.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.014702314s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13732025-02-28T10:59:34.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 39.758389ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
13742025-02-28T10:59:34.805ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 53.180131ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
13752025-02-28T10:59:34.817ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 32.975699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
13762025-02-28T10:59:34.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 89.084728ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
13772025-02-28T10:59:34.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 95.546049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
13782025-02-28T10:59:34.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 87.543743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
13792025-02-28T10:59:35.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.205604474s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
13802025-02-28T10:59:35.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 796.882924ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
13812025-02-28T10:59:35.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 224.810477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
13822025-02-28T10:59:35.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 966.539033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
13832025-02-28T10:59:35.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 73.135851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
13842025-02-28T10:59:35.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 940.682017ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
13852025-02-28T10:59:35.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 108.026637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
13862025-02-28T10:59:35.517ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.463267955s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
13872025-02-28T10:59:35.518ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13882025-02-28T10:59:35.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.239485957s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
13892025-02-28T10:59:35.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.44121919s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
13902025-02-28T10:59:35.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 244.808584ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
13912025-02-28T10:59:35.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.465406441s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
13922025-02-28T10:59:35.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 107.713635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
13932025-02-28T10:59:35.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 510.806545ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
13942025-02-28T10:59:35.630ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
13952025-02-28T10:59:35.643ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962025-02-28T10:59:35.644ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
13972025-02-28T10:59:35.682ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 207.308314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
13982025-02-28T10:59:35.736ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.108182338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
13992025-02-28T10:59:35.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 157.08611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14002025-02-28T10:59:35.846ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 546.579924ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14012025-02-28T10:59:35.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 967.552638ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
14022025-02-28T10:59:35.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 573.681047ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14032025-02-28T10:59:35.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 66.021179ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14042025-02-28T10:59:36.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 74.767493ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14052025-02-28T10:59:36.099ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 197.394768ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14062025-02-28T10:59:36.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 877.4824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
14072025-02-28T10:59:36.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.063641373s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
14082025-02-28T10:59:36.310ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 535.814518ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14092025-02-28T10:59:36.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 577.755984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14102025-02-28T10:59:36.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.450624316s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
14112025-02-28T10:59:36.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 894.225327ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
14122025-02-28T10:59:36.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 858.995781ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14132025-02-28T10:59:36.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.148278407s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
14142025-02-28T10:59:36.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 47.478734ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14152025-02-28T10:59:36.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 808.051475ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
14162025-02-28T10:59:36.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 95.738414ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14172025-02-28T10:59:36.804ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-02-28T10:59:36.804ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14192025-02-28T10:59:36.804ZINFOSledAgent (ServiceManager): Booting oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14202025-02-28T10:59:36.811ZINFOSledAgent (ServiceManager): Booting oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14212025-02-28T10:59:36.839ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='e48a4f46-1a6f-418f-a5a7-e97c705cc065'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14222025-02-28T10:59:36.839ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14232025-02-28T10:59:36.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 732.601845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
14242025-02-28T10:59:36.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 729.583991ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14252025-02-28T10:59:36.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 753.201138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
14262025-02-28T10:59:36.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 103.333826ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14272025-02-28T10:59:37.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 1.005369335s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
14282025-02-28T10:59:37.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 982.565981ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14292025-02-28T10:59:37.039ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.240408277s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
14302025-02-28T10:59:37.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 304.85242ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14312025-02-28T10:59:37.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 929.194537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
14322025-02-28T10:59:37.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 760.173042ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
14332025-02-28T10:59:37.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 40.767515ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14342025-02-28T10:59:37.122ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 32.561702ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14352025-02-28T10:59:37.139ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 60.664097ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14362025-02-28T10:59:37.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 136.770951ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14372025-02-28T10:59:37.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 61.557702ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14382025-02-28T10:59:37.266ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 76.929815ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14392025-02-28T10:59:37.376ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 209.885091ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14402025-02-28T10:59:37.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.002866185s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
14412025-02-28T10:59:37.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 146.267591ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14422025-02-28T10:59:37.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 691.147215ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14432025-02-28T10:59:37.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 575.540064ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14442025-02-28T10:59:37.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.457928377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
14452025-02-28T10:59:37.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 116.796775ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14462025-02-28T10:59:37.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 581.415333ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14472025-02-28T10:59:37.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 531.48337ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14482025-02-28T10:59:37.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.257376926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
14492025-02-28T10:59:37.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 481.559043ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14502025-02-28T10:59:37.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 1.060213914s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14512025-02-28T10:59:37.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 661.038671ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
14522025-02-28T10:59:37.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 1.406947004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
14532025-02-28T10:59:37.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 1.319726658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
14542025-02-28T10:59:37.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.438592118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
14552025-02-28T10:59:37.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.452180915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
14562025-02-28T10:59:38.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 520.035016ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14572025-02-28T10:59:38.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 1.46716301s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
14582025-02-28T10:59:38.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 943.646634ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
14592025-02-28T10:59:38.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 1.496088429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14602025-02-28T10:59:38.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 1.052292893s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14612025-02-28T10:59:38.161ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 974.163469ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14622025-02-28T10:59:38.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 985.09559ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14632025-02-28T10:59:38.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 1.165297754s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14642025-02-28T10:59:38.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 520.723035ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
14652025-02-28T10:59:38.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 938.887884ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
14662025-02-28T10:59:38.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.034508256s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
14672025-02-28T10:59:38.562ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 1.385741234s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14682025-02-28T10:59:38.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 983.465681ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14692025-02-28T10:59:38.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 1.498968899s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
14702025-02-28T10:59:38.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.127978726s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
14712025-02-28T10:59:38.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.353337463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
14722025-02-28T10:59:39.017ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 533.417564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
14732025-02-28T10:59:39.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 756.179062ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
14742025-02-28T10:59:39.154ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 987.983282ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14752025-02-28T10:59:39.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 687.224443ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
14762025-02-28T10:59:39.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 572.137085ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14772025-02-28T10:59:39.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 558.3587ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14782025-02-28T10:59:39.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 690.694548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
14792025-02-28T10:59:39.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.20668413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
14802025-02-28T10:59:39.376ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 509.39747ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
14812025-02-28T10:59:39.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 1.155672213s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
14822025-02-28T10:59:39.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 682.550605ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
14832025-02-28T10:59:39.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 920.513516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
14842025-02-28T10:59:39.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 620.106637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
14852025-02-28T10:59:39.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 623.475837ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14862025-02-28T10:59:39.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 975.112345ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
14872025-02-28T10:59:39.777ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 530.068751ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
14882025-02-28T10:59:39.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 1.069259569s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
14892025-02-28T10:59:39.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 886.275596ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
14902025-02-28T10:59:39.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 845.257822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
14912025-02-28T10:59:39.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 855.852276ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
14922025-02-28T10:59:39.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 1.088480835s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
14932025-02-28T10:59:40.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 589.995304ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
14942025-02-28T10:59:40.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 849.171102ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
14952025-02-28T10:59:40.158ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 1.444964705s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
14962025-02-28T10:59:40.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 953.864673ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
14972025-02-28T10:59:40.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 877.153643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
14982025-02-28T10:59:40.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 920.622229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
14992025-02-28T10:59:40.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8") failed: Property not found. retry in 1.466339248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
15002025-02-28T10:59:40.324ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 1.386503483s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15012025-02-28T10:59:40.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 774.632025ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
15022025-02-28T10:59:40.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 635.300807ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
15032025-02-28T10:59:40.557ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c") failed: Property not found. retry in 1.466258301s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
15042025-02-28T10:59:40.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 977.236538ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15052025-02-28T10:59:40.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3") failed: Property not found. retry in 1.387938594s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
15062025-02-28T10:59:40.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 974.794795ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
15072025-02-28T10:59:40.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 1.368900827s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
15082025-02-28T10:59:40.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a") failed: Property not found. retry in 876.210736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
15092025-02-28T10:59:40.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16") failed: Property not found. retry in 1.031516529s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
15102025-02-28T10:59:40.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 1.42321135s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15112025-02-28T10:59:40.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c") failed: Property not found. retry in 1.29001708s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
15122025-02-28T10:59:41.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 1.488682081s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
15132025-02-28T10:59:41.068ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15142025-02-28T10:59:41.068ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15152025-02-28T10:59:41.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331") failed: Property not found. retry in 994.224081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
15162025-02-28T10:59:41.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 888.233005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
15172025-02-28T10:59:41.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a") failed: Property not found. retry in 711.738968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
15182025-02-28T10:59:41.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8") failed: Property not found. retry in 1.34456261s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
15192025-02-28T10:59:41.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 745.039448ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15202025-02-28T10:59:41.213ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53094
15212025-02-28T10:59:41.218ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3015 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53094 req_id = 49e034b4-37ff-4f63-b7f4-80c30b44a9b1 response_code = 200 uri = /baseboard
15222025-02-28T10:59:41.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 40.320396ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15232025-02-28T10:59:41.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 89.648451ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15242025-02-28T10:59:41.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 159.692218ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15252025-02-28T10:59:41.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 1.088381217s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15262025-02-28T10:59:41.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 1.49769033s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
15272025-02-28T10:59:41.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 1.207952073s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
15282025-02-28T10:59:41.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 638.761068ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15292025-02-28T10:59:41.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 432.312387ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15302025-02-28T10:59:41.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 1.13283026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15312025-02-28T10:59:42.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 1.35596571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
15322025-02-28T10:59:42.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 756.1508ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
15332025-02-28T10:59:42.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 522.553994ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15342025-02-28T10:59:42.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 1.062951375s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15352025-02-28T10:59:42.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 1.099122698s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15362025-02-28T10:59:42.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 1.280835153s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
15372025-02-28T10:59:42.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 585.307577ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15382025-02-28T10:59:42.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 703.380287ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15392025-02-28T10:59:42.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 1.291731474s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
15402025-02-28T10:59:42.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 1.187778982s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
15412025-02-28T10:59:43.067ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 882.413914ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15422025-02-28T10:59:43.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 554.347399ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
15432025-02-28T10:59:43.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 1.212326627s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15442025-02-28T10:59:43.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296") failed: Property not found. retry in 1.189171253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
15452025-02-28T10:59:43.407ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 1.345714715s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15462025-02-28T10:59:43.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 579.158149ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15472025-02-28T10:59:43.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 1.128489665s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15482025-02-28T10:59:43.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 751.121565ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
15492025-02-28T10:59:43.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 837.801865ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
15502025-02-28T10:59:43.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 606.613481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15512025-02-28T10:59:44.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 1.146284802s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15522025-02-28T10:59:44.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea") failed: Property not found. retry in 1.100379265s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
15532025-02-28T10:59:44.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070") failed: Property not found. retry in 1.369909546s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
15542025-02-28T10:59:44.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a") failed: Property not found. retry in 1.207507086s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
15552025-02-28T10:59:44.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 923.390486ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15562025-02-28T10:59:44.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258") failed: Property not found. retry in 1.472416651s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15572025-02-28T10:59:44.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad") failed: Property not found. retry in 1.404324364s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15582025-02-28T10:59:44.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4") failed: Property not found. retry in 670.820712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
15592025-02-28T10:59:44.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 513.334213ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15602025-02-28T10:59:45.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 1.103357678s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15612025-02-28T10:59:45.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2") failed: Property not found. retry in 831.055306ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15622025-02-28T10:59:45.312ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.305132585s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
15632025-02-28T10:59:45.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065") failed: Property not found. retry in 1.45102526s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15642025-02-28T10:59:46.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 567.63413ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15652025-02-28T10:59:46.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 1.219818723s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15662025-02-28T10:59:47.464ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.141064681s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
15672025-02-28T10:59:48.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4") failed: Property not found. retry in 988.595855ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15682025-02-28T10:59:49.162ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_80b2977d-cb89-4acf-9305-fe891d3444ad
15692025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_9f9031b2-6cfc-44f9-b068-e81317a23296
15702025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_e48a4f46-1a6f-418f-a5a7-e97c705cc065
15712025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_31edf858-0db0-4d38-ab9b-0a2ffb387331
15722025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_0af75e4f-3314-468e-b1a8-ef13556995ea
15732025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_eabd8971-b23c-41e0-9293-50688da518e3
15742025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_3c64ab0c-453f-4806-86d4-4483cc9fae5a
15752025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_481da4b9-37c0-46ea-8223-c760924e0da4
15762025-02-28T10:59:49.166ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_4b4a3317-bb58-4d58-8cc0-ac25d5c96c8c
15772025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_0d7a7f54-d72b-4c24-a750-d5e213a5095a
15782025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_d72a02ec-7939-4df2-9449-a9fb85ed7ae8
15792025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_3a7a56e4-5d64-4d44-a29b-d2da57350070
15802025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_04be91ff-b46f-4845-aa1f-ae07b47fbd16
15812025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_a6ff5684-7d89-4a32-84ad-85950845bdf2
15822025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_6150b424-a5da-45ed-ad5b-dbd3d99de55c
15832025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_59455d04-0b86-4c6a-9736-5dcecd2f7258
15842025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_252b67b1-e358-449e-b698-30f1c8152fa8
15852025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_1b1b9951-d4a4-431f-8c93-98d541171ff4
15862025-02-28T10:59:49.167ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_74f1547b-a833-4952-b80e-4986ebf8427a
15872025-02-28T10:59:49.178ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15882025-02-28T10:59:49.195ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15892025-02-28T10:59:49.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35884399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52970 req_id = ca7ef54b-23b3-4507-a0f8-7d523bf43d38 response_code = 204 uri = /omicron-zones
15902025-02-28T10:59:49.243ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
15912025-02-28T10:59:49.273ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15922025-02-28T10:59:49.304ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
15932025-02-28T10:59:49.345ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
15942025-02-28T10:59:49.380ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
15952025-02-28T10:59:49.491ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
15962025-02-28T10:59:49.638ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.408277446s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
15972025-02-28T10:59:49.666ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
15982025-02-28T10:59:49.768ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
15992025-02-28T10:59:49.942ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16002025-02-28T10:59:50.202ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16012025-02-28T10:59:50.403ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16022025-02-28T10:59:50.556ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16032025-02-28T10:59:50.928ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16042025-02-28T10:59:51.362ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16052025-02-28T10:59:51.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16062025-02-28T10:59:52.306ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16072025-02-28T10:59:53.081ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d262f7b2-3307-4559-9ee9-e967c445259f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16082025-02-28T10:59:54.616ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e8e14fd6-1eb7-4a8d-9297-d09871de5829", "content-length": "173", "date": "Fri, 28 Feb 2025 10:59:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d262f7b2-3307-4559-9ee9-e967c445259f\"", request_id: "e8e14fd6-1eb7-4a8d-9297-d09871de5829" } file = sled-agent/src/rack_setup/service.rs:1065
16092025-02-28T10:59:55.862ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d277141b-db05-4d4c-af5c-816afb6281b5", "content-length": "173", "date": "Fri, 28 Feb 2025 10:59:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d262f7b2-3307-4559-9ee9-e967c445259f\"", request_id: "d277141b-db05-4d4c-af5c-816afb6281b5" } file = sled-agent/src/rack_setup/service.rs:1065
16102025-02-28T10:59:57.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d7821a72-db42-4bb8-8734-d118d01be295", "content-length": "173", "date": "Fri, 28 Feb 2025 10:59:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d262f7b2-3307-4559-9ee9-e967c445259f\"", request_id: "d7821a72-db42-4bb8-8734-d118d01be295" } file = sled-agent/src/rack_setup/service.rs:1065
16112025-02-28T10:59:59.270ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a72ed439-7268-4fc8-ba2e-5a8992a254f5", "content-length": "173", "date": "Fri, 28 Feb 2025 10:59:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d262f7b2-3307-4559-9ee9-e967c445259f\"", request_id: "a72ed439-7268-4fc8-ba2e-5a8992a254f5" } file = sled-agent/src/rack_setup/service.rs:1065
16122025-02-28T11:00:02.190ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7f51eac0-8e4b-4773-a75d-ec4c74591f9d", "content-length": "173", "date": "Fri, 28 Feb 2025 11:00:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e34399da-90ab-4780-9b78-9879d23c2d5f\"", request_id: "7f51eac0-8e4b-4773-a75d-ec4c74591f9d" } file = sled-agent/src/rack_setup/service.rs:1065
16132025-02-28T11:00:05.235ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b41fce86-48b1-466c-8b88-87652b4add18", "content-length": "173", "date": "Fri, 28 Feb 2025 11:00:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e34399da-90ab-4780-9b78-9879d23c2d5f\"", request_id: "b41fce86-48b1-466c-8b88-87652b4add18" } file = sled-agent/src/rack_setup/service.rs:1065
16142025-02-28T11:00:10.121ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fd4098ad-33aa-4152-b56c-7d69dba06345", "content-length": "173", "date": "Fri, 28 Feb 2025 11:00:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e34399da-90ab-4780-9b78-9879d23c2d5f\"", request_id: "fd4098ad-33aa-4152-b56c-7d69dba06345" } file = sled-agent/src/rack_setup/service.rs:1065
16152025-02-28T11:00:11.258ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52497
16162025-02-28T11:00:11.259ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52497 req_id = 5590ffae-318d-4d2b-8c2d-5837d46bbaad response_code = 200 uri = /baseboard
16172025-02-28T11:00:13.738ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "314fc179-6ab7-4f93-9c0f-ddf415b9b377", "content-length": "173", "date": "Fri, 28 Feb 2025 11:00:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e34399da-90ab-4780-9b78-9879d23c2d5f\"", request_id: "314fc179-6ab7-4f93-9c0f-ddf415b9b377" } file = sled-agent/src/rack_setup/service.rs:1065
16182025-02-28T11:00:17.273ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "54d62aee-bb58-4e14-9e94-6c5e3a89ece2", "content-length": "173", "date": "Fri, 28 Feb 2025 11:00:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e34399da-90ab-4780-9b78-9879d23c2d5f\"", request_id: "54d62aee-bb58-4e14-9e94-6c5e3a89ece2" } file = sled-agent/src/rack_setup/service.rs:1065
16192025-02-28T11:00:19.516ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
16202025-02-28T11:00:19.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58338
16212025-02-28T11:00:19.608ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16222025-02-28T11:00:19.608ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16232025-02-28T11:00:19.608ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
16242025-02-28T11:00:19.609ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
16252025-02-28T11:00:19.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16262025-02-28T11:00:19.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd
16272025-02-28T11:00:19.651ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16282025-02-28T11:00:19.651ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_198de296-2120-47e0-aaa7-ce837077a9bd
16292025-02-28T11:00:19.676ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16302025-02-28T11:00:19.677ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3
16312025-02-28T11:00:19.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16322025-02-28T11:00:19.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3c8d4110-32ba-46e1-8821-6881348da454
16332025-02-28T11:00:19.728ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16342025-02-28T11:00:19.728ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e
16352025-02-28T11:00:19.750ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16362025-02-28T11:00:19.750ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf
16372025-02-28T11:00:19.775ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16382025-02-28T11:00:19.775ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c223d649-aefc-4563-b832-624daf4863fe
16392025-02-28T11:00:19.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16402025-02-28T11:00:19.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_191404b5-bb5f-4942-aade-4f02119d69b0
16412025-02-28T11:00:19.821ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16422025-02-28T11:00:19.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75
16432025-02-28T11:00:19.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58338 req_id = 2bf6cd11-3954-44a0-abc6-fad6388c9565 response_code = 200 uri = /inventory
16442025-02-28T11:00:24.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38773
16452025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16462025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16472025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16482025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16492025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16502025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16512025-02-28T11:00:24.974ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16522025-02-28T11:00:24.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3052 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38773 req_id = 7880ca94-345a-4f5b-b9a1-baf624b5a81c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16532025-02-28T11:00:24.977ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
16542025-02-28T11:00:24.981ZINFOSledAgent (RSS): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16552025-02-28T11:00:24.981ZINFOSledAgent (RSS): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16562025-02-28T11:00:25.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57785
16572025-02-28T11:00:25.254ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16582025-02-28T11:00:25.254ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16592025-02-28T11:00:25.254ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
16602025-02-28T11:00:25.254ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
16612025-02-28T11:00:25.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16622025-02-28T11:00:25.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd
16632025-02-28T11:00:25.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16642025-02-28T11:00:25.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_198de296-2120-47e0-aaa7-ce837077a9bd
16652025-02-28T11:00:25.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16662025-02-28T11:00:25.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3
16672025-02-28T11:00:25.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16682025-02-28T11:00:25.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3c8d4110-32ba-46e1-8821-6881348da454
16692025-02-28T11:00:25.371ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16702025-02-28T11:00:25.371ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e
16712025-02-28T11:00:25.400ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16722025-02-28T11:00:25.400ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf
16732025-02-28T11:00:25.431ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16742025-02-28T11:00:25.431ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c223d649-aefc-4563-b832-624daf4863fe
16752025-02-28T11:00:25.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16762025-02-28T11:00:25.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_191404b5-bb5f-4942-aade-4f02119d69b0
16772025-02-28T11:00:25.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38850
16782025-02-28T11:00:25.477ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16792025-02-28T11:00:25.477ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16802025-02-28T11:00:25.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16812025-02-28T11:00:25.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16822025-02-28T11:00:25.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16832025-02-28T11:00:25.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16842025-02-28T11:00:25.478ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16852025-02-28T11:00:25.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38850 req_id = 4a8be890-22fe-4b99-a14f-c7642ca98db0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16862025-02-28T11:00:25.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16872025-02-28T11:00:25.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75
16882025-02-28T11:00:25.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56628
16892025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16902025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16922025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16932025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16942025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16952025-02-28T11:00:25.504ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962025-02-28T11:00:25.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56628 req_id = 676bff52-bb7a-4600-88ad-69700bc6c56a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16972025-02-28T11:00:25.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254414 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57785 req_id = 5616f85f-4c43-4b78-b9ad-573488597934 response_code = 200 uri = /inventory
16982025-02-28T11:00:25.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63370
16992025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17002025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17012025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17032025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17042025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17052025-02-28T11:00:25.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17062025-02-28T11:00:25.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63370 req_id = 2cca1ea4-26fd-454b-9a7a-a2f08cf83d28 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17072025-02-28T11:00:28.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52190
17082025-02-28T11:00:28.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52190 req_id = d91333db-c3db-4187-871b-c6e16788edd1 response_code = 200 uri = /vpc-routes
17092025-02-28T11:00:29.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17102025-02-28T11:00:29.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52190 req_id = 28c37b21-2ba1-4498-b7d4-02aac77d62a9 response_code = 204 uri = /eip-gateways
17112025-02-28T11:00:29.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37746
17122025-02-28T11:00:29.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37746 req_id = 5ec06c08-f564-4c08-92b2-549924295dbc response_code = 200 uri = /v2p
17132025-02-28T11:00:29.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45139
17142025-02-28T11:00:29.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17152025-02-28T11:00:29.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17162025-02-28T11:00:29.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45139 req_id = 8c6fb6b5-4c88-4e39-bed4-9e0de74505f5 response_code = 204 uri = /switch-ports
17172025-02-28T11:00:29.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45139 req_id = dbde6d21-e02d-4051-a470-614497af4177 response_code = 200 uri = /network-bootstore-config
17182025-02-28T11:00:29.420ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17192025-02-28T11:00:29.420ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17202025-02-28T11:00:29.421ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17212025-02-28T11:00:29.422ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17222025-02-28T11:00:29.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3615 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45139 req_id = a930fa07-1e2a-4bc1-9bc5-5bb1aedc4ae7 response_code = 204 uri = /network-bootstore-config
17232025-02-28T11:00:29.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52190 req_id = f24a1a49-9670-4771-9c49-dbea28737469 response_code = 204 uri = /vpc-routes
17242025-02-28T11:00:30.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36738
17252025-02-28T11:00:30.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36738 req_id = cd90bb1b-35d3-431e-ba7c-8a5a1f6ff772 response_code = 200 uri = /vpc-routes
17262025-02-28T11:00:30.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17272025-02-28T11:00:30.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36738 req_id = 6f2da0b8-6fb4-4200-869a-432ac330344d response_code = 204 uri = /eip-gateways
17282025-02-28T11:00:30.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36738 req_id = 0c3c1d3f-672d-4891-af2d-337def18b987 response_code = 204 uri = /vpc-routes
17292025-02-28T11:00:30.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44548
17302025-02-28T11:00:30.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44548 req_id = d5d80780-f424-430b-9c19-0b7c6916cc1f response_code = 200 uri = /v2p
17312025-02-28T11:00:30.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37714
17322025-02-28T11:00:30.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17332025-02-28T11:00:30.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17342025-02-28T11:00:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37714 req_id = ee1416a2-c723-4913-ab0d-dee393298990 response_code = 204 uri = /switch-ports
17352025-02-28T11:00:30.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33857
17362025-02-28T11:00:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33857 req_id = 6544103f-2e34-48b7-95cd-462d4475524a response_code = 200 uri = /vpc-routes
17372025-02-28T11:00:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37714 req_id = 9efa940f-7ee0-41a7-a1cd-2c02b25dd9af response_code = 200 uri = /network-bootstore-config
17382025-02-28T11:00:30.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54644
17392025-02-28T11:00:30.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54644 req_id = c01a4012-bd50-4116-bc50-8ec45bf6cad7 response_code = 200 uri = /v2p
17402025-02-28T11:00:30.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17412025-02-28T11:00:30.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33857 req_id = 709b9813-8c81-40d7-bbc1-45a5dfd54b4c response_code = 204 uri = /eip-gateways
17422025-02-28T11:00:30.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33857 req_id = c3d12a07-bd7f-47b1-b84b-ab8240bbd189 response_code = 204 uri = /vpc-routes
17432025-02-28T11:00:30.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45452
17442025-02-28T11:00:30.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17452025-02-28T11:00:30.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17462025-02-28T11:00:31.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45452 req_id = 4603156c-be8e-4d11-8fef-0b4291d08ce6 response_code = 204 uri = /switch-ports
17472025-02-28T11:00:31.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45452 req_id = ccb7b335-9f99-4159-9ea8-89bd56b256e5 response_code = 200 uri = /network-bootstore-config
17482025-02-28T11:00:34.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62571
17492025-02-28T11:00:34.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62571 req_id = a8b94a1f-0956-46c7-ab04-ebc409758295 response_code = 200 uri = /vpc-routes
17502025-02-28T11:00:34.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17512025-02-28T11:00:34.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62571 req_id = 8a6e24f5-b25b-4251-af4d-ede3b0260d35 response_code = 204 uri = /eip-gateways
17522025-02-28T11:00:34.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62571 req_id = dd06561c-c614-4f9b-8f32-31dea3810f4c response_code = 204 uri = /vpc-routes
17532025-02-28T11:00:40.783ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:41403 remote_addr = [fd00:1122:3344:101::d]:54435 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
17542025-02-28T11:00:40.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25262 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = a8f60963-b02e-4b80-afef-d2cd84949fcd response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
17552025-02-28T11:00:41.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51732
17562025-02-28T11:00:41.295ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51732 req_id = 58196c1a-269f-44f7-9c84-82cbcad4149a response_code = 200 uri = /baseboard
17572025-02-28T11:00:59.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57216
17582025-02-28T11:00:59.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57216 req_id = 345d1cdc-3417-49b1-b7c7-02d7a8b1d651 response_code = 200 uri = /vpc-routes
17592025-02-28T11:00:59.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17602025-02-28T11:00:59.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57216 req_id = 3305e4a2-40cd-471e-917f-e09493b6cf4a response_code = 204 uri = /eip-gateways
17612025-02-28T11:00:59.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57216 req_id = ae3ed061-72ea-41cb-a465-a3e70f734167 response_code = 204 uri = /vpc-routes
17622025-02-28T11:00:59.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43401
17632025-02-28T11:00:59.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43401 req_id = e70cb01e-3634-435f-b8a2-372c9e857295 response_code = 200 uri = /v2p
17642025-02-28T11:00:59.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36191
17652025-02-28T11:00:59.298ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17662025-02-28T11:00:59.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17672025-02-28T11:00:59.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36191 req_id = 175a6bf0-fe4b-45cd-a051-9b74b9975252 response_code = 204 uri = /switch-ports
17682025-02-28T11:00:59.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36191 req_id = 07f010be-8063-4ef6-ae8f-251a3cee3201 response_code = 200 uri = /network-bootstore-config
17692025-02-28T11:01:00.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64233
17702025-02-28T11:01:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64233 req_id = 6626c167-39bb-48f7-99ba-09027f02253b response_code = 200 uri = /vpc-routes
17712025-02-28T11:01:00.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17722025-02-28T11:01:00.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64233 req_id = 68df1008-18de-4fc2-a8ed-fb864f9aeb01 response_code = 204 uri = /eip-gateways
17732025-02-28T11:01:00.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53860
17742025-02-28T11:01:00.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53860 req_id = 8ea5625c-7d15-429f-a40d-6a41e6965800 response_code = 200 uri = /v2p
17752025-02-28T11:01:00.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64233 req_id = 520b1f83-0614-4e66-90ac-6a1f964f5c1e response_code = 204 uri = /vpc-routes
17762025-02-28T11:01:00.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49607
17772025-02-28T11:01:00.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49607 req_id = 3225e464-2955-4f22-98d8-8fdb4c01618d response_code = 200 uri = /vpc-routes
17782025-02-28T11:01:00.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17792025-02-28T11:01:00.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49607 req_id = 4e922b1d-e322-448c-b748-fe9349813703 response_code = 204 uri = /eip-gateways
17802025-02-28T11:01:00.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49607 req_id = 6cc98136-bf73-4c9a-bce3-938ca777a518 response_code = 204 uri = /vpc-routes
17812025-02-28T11:01:00.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55139
17822025-02-28T11:01:00.781ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17832025-02-28T11:01:00.822ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17842025-02-28T11:01:00.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55139 req_id = cd5428a4-89e6-4ddc-9956-2c6fee66da90 response_code = 204 uri = /switch-ports
17852025-02-28T11:01:00.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55139 req_id = 11c1d1eb-4814-4447-bc56-ba18e0692130 response_code = 200 uri = /network-bootstore-config
17862025-02-28T11:01:00.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55356
17872025-02-28T11:01:00.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55356 req_id = 80c5fd3e-e086-4549-93de-d199604c3bd9 response_code = 200 uri = /v2p
17882025-02-28T11:01:01.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61022
17892025-02-28T11:01:01.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17902025-02-28T11:01:01.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17912025-02-28T11:01:01.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61022 req_id = 35ea714c-8e05-4ee3-b037-5bd57273ae4f response_code = 204 uri = /switch-ports
17922025-02-28T11:01:01.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61022 req_id = 8e1f1c8d-65d9-4730-ad45-a9c7f1d39caf response_code = 200 uri = /network-bootstore-config
17932025-02-28T11:01:10.791ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8196 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = fc25c7a0-e7fb-4ab9-a82e-567ea33c1243 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
17942025-02-28T11:01:11.328ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63434
17952025-02-28T11:01:11.328ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63434 req_id = 88120a64-6bad-4ff3-9b6d-d106fb33f867 response_code = 200 uri = /baseboard
17962025-02-28T11:01:28.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42140
17972025-02-28T11:01:28.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42140 req_id = cbe6634c-f0d3-4f4f-ba10-b0fcc1eac11f response_code = 200 uri = /vpc-routes
17982025-02-28T11:01:28.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
17992025-02-28T11:01:28.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42140 req_id = 0db20063-716b-4e6b-bac4-9964a7371bc9 response_code = 204 uri = /eip-gateways
18002025-02-28T11:01:28.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42140 req_id = 750cf196-54c5-43d6-a038-ec935a4b6300 response_code = 204 uri = /vpc-routes
18012025-02-28T11:01:28.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53406
18022025-02-28T11:01:28.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18032025-02-28T11:01:29.039ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18042025-02-28T11:01:29.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53406 req_id = 91de0bad-c848-4d0a-b8c5-e3995bfd9057 response_code = 204 uri = /switch-ports
18052025-02-28T11:01:29.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52011
18062025-02-28T11:01:29.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53406 req_id = 340123d6-e702-4538-989b-174b2163b9f2 response_code = 200 uri = /network-bootstore-config
18072025-02-28T11:01:29.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52011 req_id = e3456958-4128-4239-947e-bc9426520bfc response_code = 200 uri = /v2p
18082025-02-28T11:01:30.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61282
18092025-02-28T11:01:30.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61282 req_id = 98753eab-356d-4000-b2a7-de82ef426af0 response_code = 200 uri = /vpc-routes
18102025-02-28T11:01:30.364ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18112025-02-28T11:01:30.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61282 req_id = 799bb811-f479-4503-9ae2-4fc41f8dd71e response_code = 204 uri = /eip-gateways
18122025-02-28T11:01:30.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61282 req_id = 98eae556-8e0b-4fc8-a1b2-23c397468c01 response_code = 204 uri = /vpc-routes
18132025-02-28T11:01:30.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40287
18142025-02-28T11:01:30.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40287 req_id = e8d9e6fb-08a3-40e5-b94d-5b5956be3a2a response_code = 200 uri = /v2p
18152025-02-28T11:01:30.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48347
18162025-02-28T11:01:30.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18172025-02-28T11:01:30.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18182025-02-28T11:01:30.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48347 req_id = fcd600c6-2046-4b7b-9415-34767283145c response_code = 204 uri = /switch-ports
18192025-02-28T11:01:30.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59052
18202025-02-28T11:01:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59052 req_id = 282171e0-3e79-4d77-b184-ea9299d8d4cd response_code = 200 uri = /vpc-routes
18212025-02-28T11:01:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48347 req_id = abe7c173-25f7-4d1b-9841-de15a5263192 response_code = 200 uri = /network-bootstore-config
18222025-02-28T11:01:30.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18232025-02-28T11:01:30.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59052 req_id = b9dcf087-15ce-43a9-9c31-6f324535bd39 response_code = 204 uri = /eip-gateways
18242025-02-28T11:01:30.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59052 req_id = 1948b921-9224-4869-8c3c-83ee92e2adff response_code = 204 uri = /vpc-routes
18252025-02-28T11:01:30.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34526
18262025-02-28T11:01:30.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18272025-02-28T11:01:30.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18282025-02-28T11:01:30.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34526 req_id = c8716188-ab5e-42c3-a3bf-d95e79e8fcce response_code = 204 uri = /switch-ports
18292025-02-28T11:01:30.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36584
18302025-02-28T11:01:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34526 req_id = afbb6317-2697-4062-9912-fd6860b78c34 response_code = 200 uri = /network-bootstore-config
18312025-02-28T11:01:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36584 req_id = 40f3a789-6463-4085-a41b-3c7099f35810 response_code = 200 uri = /v2p
18322025-02-28T11:01:40.791ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7208 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 9d1a8413-7b15-4cf7-ba63-4920a48a9bea response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
18332025-02-28T11:01:41.371ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64634
18342025-02-28T11:01:41.371ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64634 req_id = dc5e7132-cbe6-40f6-a96e-dfab97e6b368 response_code = 200 uri = /baseboard
18352025-02-28T11:01:58.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49251
18362025-02-28T11:01:58.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49251 req_id = 30a8b26a-9392-4360-84d9-181364189992 response_code = 200 uri = /vpc-routes
18372025-02-28T11:01:59.067ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18382025-02-28T11:01:59.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49251 req_id = ae95145b-bc53-4c3c-a774-e1905b79d7f1 response_code = 204 uri = /eip-gateways
18392025-02-28T11:01:59.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49251 req_id = 31a61111-2307-4cbb-ac73-6407ceb406ef response_code = 204 uri = /vpc-routes
18402025-02-28T11:01:59.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64880
18412025-02-28T11:01:59.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64880 req_id = c0789082-6c14-4db4-8765-eaaa13d3d3f7 response_code = 200 uri = /v2p
18422025-02-28T11:01:59.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35008
18432025-02-28T11:01:59.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18442025-02-28T11:01:59.366ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18452025-02-28T11:01:59.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35008 req_id = 4a15d59f-a4ca-4d06-9328-717b49e21806 response_code = 204 uri = /switch-ports
18462025-02-28T11:01:59.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35008 req_id = 889eea87-a318-4625-88c9-60503e168273 response_code = 200 uri = /network-bootstore-config
18472025-02-28T11:02:00.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54068
18482025-02-28T11:02:00.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54068 req_id = 0fd0cb5e-ed60-42c0-8313-e1e6aa5d7c40 response_code = 200 uri = /vpc-routes
18492025-02-28T11:02:00.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62894
18502025-02-28T11:02:00.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62894 req_id = 4f01b636-93bd-4cee-a082-9f357e0ca513 response_code = 200 uri = /v2p
18512025-02-28T11:02:00.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18522025-02-28T11:02:00.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54068 req_id = 022a258e-3993-4435-bb5a-ddfbf3dba1b7 response_code = 204 uri = /eip-gateways
18532025-02-28T11:02:00.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54068 req_id = 9a604f2d-4c94-4f65-ae27-64cf15916b2e response_code = 204 uri = /vpc-routes
18542025-02-28T11:02:00.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33449
18552025-02-28T11:02:00.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18562025-02-28T11:02:00.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18572025-02-28T11:02:00.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33449 req_id = 2cf39d33-f14d-4c2e-8030-fef1714bbf3d response_code = 204 uri = /switch-ports
18582025-02-28T11:02:00.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33449 req_id = c6edc77a-63c5-484c-b98e-0eab851cc33f response_code = 200 uri = /network-bootstore-config
18592025-02-28T11:02:00.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54650
18602025-02-28T11:02:00.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54650 req_id = f679d2fa-41fc-4060-8f2a-5c51c568c964 response_code = 200 uri = /vpc-routes
18612025-02-28T11:02:00.723ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18622025-02-28T11:02:00.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54650 req_id = 55d65a0d-a14d-441c-9a27-b4a69154b6ff response_code = 204 uri = /eip-gateways
18632025-02-28T11:02:00.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54650 req_id = cd056267-8424-4036-b736-c11a83e740b4 response_code = 204 uri = /vpc-routes
18642025-02-28T11:02:00.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62252
18652025-02-28T11:02:00.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62252 req_id = e76f57aa-d722-47e3-adb6-83188e41ba32 response_code = 200 uri = /v2p
18662025-02-28T11:02:00.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49019
18672025-02-28T11:02:00.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18682025-02-28T11:02:00.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18692025-02-28T11:02:01.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49019 req_id = 30602365-a8e2-46ce-9688-4742cc523d2e response_code = 204 uri = /switch-ports
18702025-02-28T11:02:01.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49019 req_id = 179a6618-1a46-49db-ac5d-d16dbffd6990 response_code = 200 uri = /network-bootstore-config
18712025-02-28T11:02:10.791ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7683 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = e1d5f3e6-4411-43c8-91cd-5938c2a19239 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
18722025-02-28T11:02:11.406ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41970
18732025-02-28T11:02:11.407ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41970 req_id = 7691e1bb-0d0f-4bb9-8671-1aa925e2af7f response_code = 200 uri = /baseboard
18742025-02-28T11:02:28.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48207
18752025-02-28T11:02:28.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48207 req_id = 68b7bef2-5387-48c1-b675-0513eacceccb response_code = 200 uri = /vpc-routes
18762025-02-28T11:02:28.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18772025-02-28T11:02:28.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48207 req_id = 68b019b3-3dca-4042-bdea-d525e218faf4 response_code = 204 uri = /eip-gateways
18782025-02-28T11:02:28.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62923
18792025-02-28T11:02:28.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62923 req_id = 9c271397-2e2c-4faf-ae4a-b8f06cd5582d response_code = 200 uri = /v2p
18802025-02-28T11:02:28.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48207 req_id = 109290ce-9c6c-43b9-a42d-857bebbacc9a response_code = 204 uri = /vpc-routes
18812025-02-28T11:02:28.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35800
18822025-02-28T11:02:28.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18832025-02-28T11:02:28.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18842025-02-28T11:02:29.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35800 req_id = f800588a-ce2f-4846-94f1-46da52b85d92 response_code = 204 uri = /switch-ports
18852025-02-28T11:02:29.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35800 req_id = 57496edb-f226-4c35-a846-3ca3fe6d004e response_code = 200 uri = /network-bootstore-config
18862025-02-28T11:02:30.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53469
18872025-02-28T11:02:30.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53469 req_id = 711980d6-ee11-4609-9d0e-98ca0aec0c00 response_code = 200 uri = /vpc-routes
18882025-02-28T11:02:30.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
18892025-02-28T11:02:30.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53469 req_id = 20f26501-ba88-4626-8897-43a597e5e8d6 response_code = 204 uri = /eip-gateways
18902025-02-28T11:02:30.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53469 req_id = 6578ad2a-fa40-4200-804c-f2d4ffefa77a response_code = 204 uri = /vpc-routes
18912025-02-28T11:02:30.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48003
18922025-02-28T11:02:30.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48003 req_id = 00d1afd0-43cc-4039-967a-54037ca4f186 response_code = 200 uri = /v2p
18932025-02-28T11:02:30.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33139
18942025-02-28T11:02:30.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18952025-02-28T11:02:30.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18962025-02-28T11:02:30.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33139 req_id = c9a341cb-d030-4e26-9063-4ff9c3e81020 response_code = 204 uri = /switch-ports
18972025-02-28T11:02:30.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63986
18982025-02-28T11:02:30.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63986 req_id = d55094d7-d8e5-44c1-bcf0-992cbdf0a20f response_code = 200 uri = /vpc-routes
18992025-02-28T11:02:30.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33139 req_id = b2b8d334-4272-4eb5-9926-4bfc09a2288d response_code = 200 uri = /network-bootstore-config
19002025-02-28T11:02:30.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53620
19012025-02-28T11:02:30.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53620 req_id = ca25ff7d-3686-4271-8bf5-32de8de9229b response_code = 200 uri = /v2p
19022025-02-28T11:02:30.620ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19032025-02-28T11:02:30.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63986 req_id = 09743764-fd84-42ed-ab67-b92b10a50685 response_code = 204 uri = /eip-gateways
19042025-02-28T11:02:30.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63986 req_id = 3e5c85d7-02e9-4ef6-b84c-50bac70f2ebd response_code = 204 uri = /vpc-routes
19052025-02-28T11:02:30.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39846
19062025-02-28T11:02:30.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19072025-02-28T11:02:30.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19082025-02-28T11:02:30.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39846 req_id = 2ff0f7da-ae24-49d5-b6d2-a769e5c866c1 response_code = 204 uri = /switch-ports
19092025-02-28T11:02:30.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39846 req_id = 943d00bb-6167-4e66-b2a6-543fd4602d17 response_code = 200 uri = /network-bootstore-config
19102025-02-28T11:02:40.792ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7716 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = f89a8e2a-407c-43da-bc99-611b58d2b14b response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
19112025-02-28T11:02:41.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54723
19122025-02-28T11:02:41.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54723 req_id = b9e4e18c-cd08-4b73-9ee8-5ecedf240247 response_code = 200 uri = /baseboard
19132025-02-28T11:02:49.478ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19142025-02-28T11:02:58.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42304
19152025-02-28T11:02:58.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42304 req_id = 5ceaa238-f4ee-4c90-85c9-710c6f5c46ca response_code = 200 uri = /vpc-routes
19162025-02-28T11:02:58.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50292
19172025-02-28T11:02:58.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50292 req_id = ea98ac0f-9e27-4900-9395-75acf990a882 response_code = 200 uri = /v2p
19182025-02-28T11:02:58.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19192025-02-28T11:02:58.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42304 req_id = a4dd94a9-1573-4c4d-8102-536985afb277 response_code = 204 uri = /eip-gateways
19202025-02-28T11:02:59.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42304 req_id = 6b90d12a-c4a4-4d09-af7b-3c3693ef44ed response_code = 204 uri = /vpc-routes
19212025-02-28T11:02:59.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38708
19222025-02-28T11:02:59.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19232025-02-28T11:02:59.162ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19242025-02-28T11:02:59.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38708 req_id = 484705c5-395e-489a-bdcc-672583b3f350 response_code = 204 uri = /switch-ports
19252025-02-28T11:02:59.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38708 req_id = 183b2b38-1ae0-4848-b9ba-79085c56e888 response_code = 200 uri = /network-bootstore-config
19262025-02-28T11:03:00.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49670
19272025-02-28T11:03:00.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49670 req_id = a4038e3e-3a43-4ec0-adfa-b528f975c69e response_code = 200 uri = /vpc-routes
19282025-02-28T11:03:00.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19292025-02-28T11:03:00.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49670 req_id = 97355758-54b2-4f2e-a44a-7b4fbe2802d0 response_code = 204 uri = /eip-gateways
19302025-02-28T11:03:00.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49670 req_id = f3865521-f571-4144-a004-b1053fdaf38e response_code = 204 uri = /vpc-routes
19312025-02-28T11:03:00.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59625
19322025-02-28T11:03:00.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59625 req_id = 4e2188b5-6137-49e8-8527-4366fb5dfc3b response_code = 200 uri = /v2p
19332025-02-28T11:03:00.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47320
19342025-02-28T11:03:00.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19352025-02-28T11:03:00.645ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19362025-02-28T11:03:00.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98899 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47320 req_id = 5c914b36-1d1c-46f7-afd0-61f9de178863 response_code = 204 uri = /switch-ports
19372025-02-28T11:03:00.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47320 req_id = 55ef540e-ec73-47e6-973a-f047dbe359fa response_code = 200 uri = /network-bootstore-config
19382025-02-28T11:03:00.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35056
19392025-02-28T11:03:00.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35056 req_id = fdac44a7-e93b-4736-9991-01e614026b91 response_code = 200 uri = /vpc-routes
19402025-02-28T11:03:00.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19412025-02-28T11:03:00.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35056 req_id = 06820d41-5c24-401e-82d4-c5ed3f08045e response_code = 204 uri = /eip-gateways
19422025-02-28T11:03:00.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40555
19432025-02-28T11:03:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40555 req_id = bdb23091-186a-4a65-80ab-9acaaa7b7718 response_code = 200 uri = /v2p
19442025-02-28T11:03:00.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35056 req_id = 1c6d783a-7bb1-4c7d-a756-32af4802094b response_code = 204 uri = /vpc-routes
19452025-02-28T11:03:00.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57218
19462025-02-28T11:03:00.906ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19472025-02-28T11:03:00.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19482025-02-28T11:03:00.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91191 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57218 req_id = 677d0325-6aa5-40c9-a05c-b79f95cbdc3a response_code = 204 uri = /switch-ports
19492025-02-28T11:03:00.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57218 req_id = 9478307d-b36e-4486-92cd-b2c21e49b096 response_code = 200 uri = /network-bootstore-config
19502025-02-28T11:03:10.793ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8482 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = e4afd21c-9730-4538-af74-a78f3a7438c9 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
19512025-02-28T11:03:11.474ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51192
19522025-02-28T11:03:11.474ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51192 req_id = 3c8e49e9-abab-4573-bcaa-890f2e297d20 response_code = 200 uri = /baseboard
19532025-02-28T11:03:28.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43282
19542025-02-28T11:03:28.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43282 req_id = 8f0988c7-6b62-48cb-8bab-8bfcbe34168f response_code = 200 uri = /vpc-routes
19552025-02-28T11:03:28.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19562025-02-28T11:03:28.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43282 req_id = f8badbb3-8128-43fb-b674-a8e0fa8eaaf1 response_code = 204 uri = /eip-gateways
19572025-02-28T11:03:28.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43282 req_id = 67fbd833-a763-4a82-9cf9-7e42ca8c0744 response_code = 204 uri = /vpc-routes
19582025-02-28T11:03:29.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64232
19592025-02-28T11:03:29.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64232 req_id = 8797a26f-62c9-4808-a56a-831be8828295 response_code = 200 uri = /v2p
19602025-02-28T11:03:29.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45464
19612025-02-28T11:03:29.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19622025-02-28T11:03:29.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19632025-02-28T11:03:29.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45464 req_id = 357d7ddd-c489-4fc5-8a00-4c2156734614 response_code = 204 uri = /switch-ports
19642025-02-28T11:03:29.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45464 req_id = a45ab23e-da8f-4a2c-a6e2-9964d812da90 response_code = 200 uri = /network-bootstore-config
19652025-02-28T11:03:30.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51049
19662025-02-28T11:03:30.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51049 req_id = 12e07924-1476-473b-8990-d640dd6b3a9c response_code = 200 uri = /vpc-routes
19672025-02-28T11:03:30.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50419
19682025-02-28T11:03:30.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50419 req_id = a6c48639-70dd-404e-934b-df9308e0f6cc response_code = 200 uri = /v2p
19692025-02-28T11:03:30.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19702025-02-28T11:03:30.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51049 req_id = c955e1d1-d924-49ed-a8cf-77165d6fff56 response_code = 204 uri = /eip-gateways
19712025-02-28T11:03:30.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51049 req_id = f0ad72f1-7d9a-44ba-858e-669a08550acb response_code = 204 uri = /vpc-routes
19722025-02-28T11:03:30.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46713
19732025-02-28T11:03:30.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19742025-02-28T11:03:30.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19752025-02-28T11:03:30.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46713 req_id = fd1572b5-e6c5-418b-9ea8-915dba52bf83 response_code = 204 uri = /switch-ports
19762025-02-28T11:03:30.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60783
19772025-02-28T11:03:30.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60783 req_id = e0bdde0b-b07b-4ec3-b96a-e336cd73ef1f response_code = 200 uri = /vpc-routes
19782025-02-28T11:03:30.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46713 req_id = 02fe7d4e-8fc6-4113-9f06-ba6e4f6014c1 response_code = 200 uri = /network-bootstore-config
19792025-02-28T11:03:30.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19802025-02-28T11:03:30.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60783 req_id = a1b16fef-7169-497b-9959-f21cecf14797 response_code = 204 uri = /eip-gateways
19812025-02-28T11:03:30.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44797
19822025-02-28T11:03:30.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44797 req_id = 1a3136b0-5d53-43ce-85af-6e407ae964ae response_code = 200 uri = /v2p
19832025-02-28T11:03:30.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60783 req_id = 926ac791-393e-49b5-9758-5b237ae6170c response_code = 204 uri = /vpc-routes
19842025-02-28T11:03:30.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54140
19852025-02-28T11:03:30.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19862025-02-28T11:03:30.740ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19872025-02-28T11:03:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54140 req_id = ae482f9f-7668-40d6-a648-b8560ab19060 response_code = 204 uri = /switch-ports
19882025-02-28T11:03:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54140 req_id = c91f909d-46ff-4cf6-a253-4b8c3405338a response_code = 200 uri = /network-bootstore-config
19892025-02-28T11:03:40.792ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7290 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 0f9275d6-c2ca-4bfb-974d-b78e7e243d20 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
19902025-02-28T11:03:41.507ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39965
19912025-02-28T11:03:41.507ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39965 req_id = 230cbc57-8cc9-4619-b3a6-6fef351f6d19 response_code = 200 uri = /baseboard
19922025-02-28T11:03:58.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50556
19932025-02-28T11:03:58.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50556 req_id = 0cea139a-a186-4cb3-a433-14cbff2dc1c9 response_code = 200 uri = /vpc-routes
19942025-02-28T11:03:58.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
19952025-02-28T11:03:58.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50556 req_id = eb25fbcd-0c1a-4bd5-873c-cd9527fa98ac response_code = 204 uri = /eip-gateways
19962025-02-28T11:03:59.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42943
19972025-02-28T11:03:59.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42943 req_id = 6731fcf5-0bba-4243-bdf8-cc649bc3edc3 response_code = 200 uri = /v2p
19982025-02-28T11:03:59.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50556 req_id = 15f92e4a-42f5-4dda-8e03-ad7e2f28d7a3 response_code = 204 uri = /vpc-routes
19992025-02-28T11:03:59.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43225
20002025-02-28T11:03:59.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20012025-02-28T11:03:59.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20022025-02-28T11:03:59.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43225 req_id = 1a9fea9c-5da8-4ad5-80bb-e4508eb5217b response_code = 204 uri = /switch-ports
20032025-02-28T11:03:59.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43225 req_id = 660804cc-e4df-4fce-bcfc-e84d8a3e0623 response_code = 200 uri = /network-bootstore-config
20042025-02-28T11:04:00.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43668
20052025-02-28T11:04:00.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43668 req_id = f7148905-0e8a-43e9-b440-85144ab361d4 response_code = 200 uri = /vpc-routes
20062025-02-28T11:04:00.568ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20072025-02-28T11:04:00.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43668 req_id = a123e096-a190-4823-a27d-013a7bb73b55 response_code = 204 uri = /eip-gateways
20082025-02-28T11:04:00.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50172
20092025-02-28T11:04:00.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50172 req_id = c1f15f35-d572-4d9d-ba23-af042088f0d7 response_code = 200 uri = /v2p
20102025-02-28T11:04:00.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43668 req_id = 1c89a808-5ab7-45af-b21a-33315f249c33 response_code = 204 uri = /vpc-routes
20112025-02-28T11:04:00.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55313
20122025-02-28T11:04:00.688ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20132025-02-28T11:04:00.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20142025-02-28T11:04:00.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55313 req_id = fb5c424d-b736-4b8f-a311-017f3a42f9e9 response_code = 204 uri = /switch-ports
20152025-02-28T11:04:00.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39619
20162025-02-28T11:04:00.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39619 req_id = 4e4dbf80-0307-4ef0-8c51-0c55a597f0d6 response_code = 200 uri = /vpc-routes
20172025-02-28T11:04:00.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55313 req_id = a444bf40-3624-4e55-95ab-a563f6781c89 response_code = 200 uri = /network-bootstore-config
20182025-02-28T11:04:00.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20192025-02-28T11:04:00.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39619 req_id = c6046186-e8e2-4cb4-a342-3a9aa0468beb response_code = 204 uri = /eip-gateways
20202025-02-28T11:04:01.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58898
20212025-02-28T11:04:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58898 req_id = 5c841481-cc8f-4a22-a5fb-899a8344a991 response_code = 200 uri = /v2p
20222025-02-28T11:04:01.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39619 req_id = 8e2267ff-9198-4aa2-863a-f46a78e8b6c6 response_code = 204 uri = /vpc-routes
20232025-02-28T11:04:01.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50645
20242025-02-28T11:04:01.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20252025-02-28T11:04:01.068ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20262025-02-28T11:04:01.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50645 req_id = 6f424717-cd04-4da3-808d-1883e4fb1081 response_code = 204 uri = /switch-ports
20272025-02-28T11:04:01.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50645 req_id = 7a3afdd4-3f76-4729-94ad-e8dbc25ffe10 response_code = 200 uri = /network-bootstore-config
20282025-02-28T11:04:10.792ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6918 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = b8093e2e-dddc-424c-aa8e-f8c4af24d549 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
20292025-02-28T11:04:11.542ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43173
20302025-02-28T11:04:11.542ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43173 req_id = 9c105d9a-dd19-4f2a-be6c-f5695c7c292c response_code = 200 uri = /baseboard
20312025-02-28T11:04:28.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61489
20322025-02-28T11:04:28.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61489 req_id = 95bdf011-298c-4380-aba7-e73b90b49174 response_code = 200 uri = /vpc-routes
20332025-02-28T11:04:28.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20342025-02-28T11:04:28.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61489 req_id = 67339362-a508-4864-8b64-ab4dccf23c33 response_code = 204 uri = /eip-gateways
20352025-02-28T11:04:28.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61489 req_id = 9bdc226b-169a-4f6d-b393-f7ac1a41f47a response_code = 204 uri = /vpc-routes
20362025-02-28T11:04:28.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57049
20372025-02-28T11:04:28.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57049 req_id = 8fb481d0-b5a3-4cc5-930f-b0cf7f5b9560 response_code = 200 uri = /v2p
20382025-02-28T11:04:29.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54414
20392025-02-28T11:04:29.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20402025-02-28T11:04:29.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20412025-02-28T11:04:29.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54414 req_id = 2481424d-4b2c-47f7-a46d-30ec5feaa367 response_code = 204 uri = /switch-ports
20422025-02-28T11:04:29.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54414 req_id = 75aa8875-aff6-4661-87d4-06853913daf8 response_code = 200 uri = /network-bootstore-config
20432025-02-28T11:04:30.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47010
20442025-02-28T11:04:30.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47010 req_id = df441044-d7c9-4e0f-880d-972ffccd7c34 response_code = 200 uri = /vpc-routes
20452025-02-28T11:04:30.221ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20462025-02-28T11:04:30.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47010 req_id = beae17b5-2729-41a9-bee7-4c8a52cb8082 response_code = 204 uri = /eip-gateways
20472025-02-28T11:04:30.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47010 req_id = 04adb6f7-db66-4035-818a-80f1ca7adfd9 response_code = 204 uri = /vpc-routes
20482025-02-28T11:04:30.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35647
20492025-02-28T11:04:30.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35647 req_id = 6409dd96-d0ba-4676-a0de-29ac33bd65e3 response_code = 200 uri = /v2p
20502025-02-28T11:04:30.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49128
20512025-02-28T11:04:30.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20522025-02-28T11:04:30.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20532025-02-28T11:04:30.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49128 req_id = 9a5ba565-6064-4b6c-b93d-8ed602aa426c response_code = 204 uri = /switch-ports
20542025-02-28T11:04:30.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49128 req_id = 01f37a74-bd23-4c77-8523-2d9a86e40132 response_code = 200 uri = /network-bootstore-config
20552025-02-28T11:04:30.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52732
20562025-02-28T11:04:30.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52732 req_id = 8a975b44-a3a6-4578-be29-12d7fcff55e8 response_code = 200 uri = /vpc-routes
20572025-02-28T11:04:30.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20582025-02-28T11:04:30.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52732 req_id = 9124e377-4a66-420a-b50e-9abe74576a8f response_code = 204 uri = /eip-gateways
20592025-02-28T11:04:30.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52732 req_id = f1e145cf-0cc2-45e4-8d96-061029bb74bb response_code = 204 uri = /vpc-routes
20602025-02-28T11:04:30.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35404
20612025-02-28T11:04:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35404 req_id = b84b0387-47e6-43d0-b594-dc370130f862 response_code = 200 uri = /v2p
20622025-02-28T11:04:30.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41164
20632025-02-28T11:04:30.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20642025-02-28T11:04:30.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20652025-02-28T11:04:30.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41164 req_id = 3216d6fa-4365-4634-a58e-9aa213070857 response_code = 204 uri = /switch-ports
20662025-02-28T11:04:30.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41164 req_id = cf002f5d-202d-4473-a38f-6cee3c886afc response_code = 200 uri = /network-bootstore-config
20672025-02-28T11:04:40.793ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6954 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 57dbf344-6a8f-4ff7-8f95-36fe56b6cdc4 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
20682025-02-28T11:04:41.577ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33411
20692025-02-28T11:04:41.577ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33411 req_id = 49ec2055-0205-4ca1-8bba-64a16ba6f111 response_code = 200 uri = /baseboard
20702025-02-28T11:04:59.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52034
20712025-02-28T11:04:59.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52034 req_id = 07f1a7df-61f3-4556-93d2-64d99103ee21 response_code = 200 uri = /vpc-routes
20722025-02-28T11:04:59.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50868
20732025-02-28T11:04:59.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20742025-02-28T11:04:59.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50868 req_id = 27c57983-eac6-4994-933e-45aaf24a7030 response_code = 200 uri = /artifacts
20752025-02-28T11:04:59.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20762025-02-28T11:04:59.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52034 req_id = 492c0440-db1c-4dd8-8630-1e76a432c12d response_code = 204 uri = /eip-gateways
20772025-02-28T11:04:59.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58516
20782025-02-28T11:04:59.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58516 req_id = 068da838-1bad-4151-9a40-68dd4cfdf646 response_code = 200 uri = /v2p
20792025-02-28T11:04:59.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52034 req_id = 9ef3b5ab-c114-468a-b38c-9b4b35eab0e3 response_code = 204 uri = /vpc-routes
20802025-02-28T11:04:59.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49180
20812025-02-28T11:04:59.250ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20822025-02-28T11:04:59.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20832025-02-28T11:04:59.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49180 req_id = 90e36a79-56a2-4868-ae09-eeee3d05ad19 response_code = 204 uri = /switch-ports
20842025-02-28T11:04:59.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49180 req_id = d215c22b-5668-4f57-9f31-12a200ab22c9 response_code = 200 uri = /network-bootstore-config
20852025-02-28T11:04:59.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34647
20862025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20872025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20882025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20892025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20902025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
20912025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20922025-02-28T11:04:59.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20932025-02-28T11:04:59.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34647 req_id = 626562b3-bd1d-4bac-8f22-30ace66dbb90 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20942025-02-28T11:05:00.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38787
20952025-02-28T11:05:00.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38787 req_id = 8edfdc55-383e-4201-9045-8925d451db46 response_code = 200 uri = /vpc-routes
20962025-02-28T11:05:00.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
20972025-02-28T11:05:00.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38787 req_id = 0df664b2-2023-49de-9754-b894309f9241 response_code = 204 uri = /eip-gateways
20982025-02-28T11:05:00.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43279
20992025-02-28T11:05:00.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21002025-02-28T11:05:00.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43279 req_id = 1a5a4c7e-0a3d-4574-b9d8-5c5d36e59195 response_code = 200 uri = /artifacts
21012025-02-28T11:05:00.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38787 req_id = 6f62de34-a110-41c0-abac-a2132c4463bf response_code = 204 uri = /vpc-routes
21022025-02-28T11:05:00.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35618
21032025-02-28T11:05:00.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35618 req_id = fa927d74-155d-4a53-b5df-90e37ee5e7c3 response_code = 200 uri = /v2p
21042025-02-28T11:05:00.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46797
21052025-02-28T11:05:00.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21062025-02-28T11:05:00.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21072025-02-28T11:05:00.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46797 req_id = 41ff8a91-94ea-4d10-b16c-4181e6d28c00 response_code = 204 uri = /switch-ports
21082025-02-28T11:05:00.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46797 req_id = 361ecb61-a246-4063-a4ce-7e18b0e7d56a response_code = 200 uri = /network-bootstore-config
21092025-02-28T11:05:00.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50601
21102025-02-28T11:05:00.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50601 req_id = 6c38cf3b-60f8-46f6-b309-5d660f92ca80 response_code = 200 uri = /vpc-routes
21112025-02-28T11:05:00.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54108
21122025-02-28T11:05:00.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21132025-02-28T11:05:00.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54108 req_id = 0fafeb78-345b-4815-b452-35b2e2be5171 response_code = 200 uri = /artifacts
21142025-02-28T11:05:00.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60111
21152025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21162025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21172025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21182025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21192025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21202025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21212025-02-28T11:05:00.867ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21222025-02-28T11:05:00.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60111 req_id = 6eaa2e8c-2754-445a-bb02-b28a0b60acc4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21232025-02-28T11:05:00.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21242025-02-28T11:05:00.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50601 req_id = a7ef1050-f653-44f7-aca5-4c45bbe1f262 response_code = 204 uri = /eip-gateways
21252025-02-28T11:05:00.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56532
21262025-02-28T11:05:00.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56532 req_id = 82e90e68-b077-4448-a7ad-a3c452c082af response_code = 200 uri = /v2p
21272025-02-28T11:05:00.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50601 req_id = dd3a99d7-c101-49f5-bca5-e0e244b2255c response_code = 204 uri = /vpc-routes
21282025-02-28T11:05:00.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54277
21292025-02-28T11:05:00.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21302025-02-28T11:05:00.994ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21312025-02-28T11:05:01.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54277 req_id = bfc19d43-ca64-4b5a-ac2c-3f8e3af964ed response_code = 204 uri = /switch-ports
21322025-02-28T11:05:01.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54277 req_id = dbfa7d9a-4a7e-4961-b7c5-770879a9d9cb response_code = 200 uri = /network-bootstore-config
21332025-02-28T11:05:01.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36650
21342025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21352025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21362025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21372025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21382025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21392025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21402025-02-28T11:05:01.179ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21412025-02-28T11:05:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36650 req_id = 69616624-b0ed-41dc-836c-e9b5617f01d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21422025-02-28T11:05:10.794ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7631 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = c56cec92-e016-4e0e-8cb1-610338c5a902 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
21432025-02-28T11:05:11.612ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40151
21442025-02-28T11:05:11.612ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40151 req_id = 145a94e7-f9ac-4a37-8b74-d16c2361aa70 response_code = 200 uri = /baseboard
21452025-02-28T11:05:28.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54371
21462025-02-28T11:05:28.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54371 req_id = 34f099ee-e080-4912-9b65-902c4b829c0c response_code = 200 uri = /vpc-routes
21472025-02-28T11:05:28.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21482025-02-28T11:05:28.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54371 req_id = 23b4d0b2-1f43-4e6b-b7f3-6c90e7d8a0ea response_code = 204 uri = /eip-gateways
21492025-02-28T11:05:28.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55078
21502025-02-28T11:05:28.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21512025-02-28T11:05:28.885ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21522025-02-28T11:05:28.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55078 req_id = c52da57a-edbd-4d89-90ac-2d5a9f4b2a58 response_code = 204 uri = /switch-ports
21532025-02-28T11:05:28.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52605
21542025-02-28T11:05:28.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55078 req_id = 96729c9f-a61f-43e1-932f-3fa847af8874 response_code = 200 uri = /network-bootstore-config
21552025-02-28T11:05:28.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52605 req_id = 16969367-2701-4c9c-9318-553789a52888 response_code = 200 uri = /v2p
21562025-02-28T11:05:28.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54371 req_id = d269a43a-3cb7-4635-91bc-eba0c8b2ea11 response_code = 204 uri = /vpc-routes
21572025-02-28T11:05:30.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45227
21582025-02-28T11:05:30.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45227 req_id = 46e34595-028f-4900-a2d9-5784295f3e8e response_code = 200 uri = /vpc-routes
21592025-02-28T11:05:30.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21602025-02-28T11:05:30.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45227 req_id = 8b546898-6e7c-4ea2-aca7-0a8018d748d5 response_code = 204 uri = /eip-gateways
21612025-02-28T11:05:30.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45227 req_id = 6901fb23-2b44-449d-b685-eca23784b2b2 response_code = 204 uri = /vpc-routes
21622025-02-28T11:05:30.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49257
21632025-02-28T11:05:30.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49257 req_id = 84198e17-0497-4ff2-9b4f-4dc291886e68 response_code = 200 uri = /v2p
21642025-02-28T11:05:30.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63199
21652025-02-28T11:05:30.455ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21662025-02-28T11:05:30.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21672025-02-28T11:05:30.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63199 req_id = 8aed3269-bcec-48ce-a404-e5ee8215a0ea response_code = 204 uri = /switch-ports
21682025-02-28T11:05:30.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63199 req_id = 6caf3237-8d5e-42a8-ada1-576b866dbba6 response_code = 200 uri = /network-bootstore-config
21692025-02-28T11:05:30.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43769
21702025-02-28T11:05:30.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43769 req_id = 802f5a1a-7542-4393-b845-cfe31db841a1 response_code = 200 uri = /vpc-routes
21712025-02-28T11:05:30.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21722025-02-28T11:05:30.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43769 req_id = fa6272e8-846f-4534-b7a5-bf516bf0b981 response_code = 204 uri = /eip-gateways
21732025-02-28T11:05:30.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43769 req_id = a2292000-ce4e-4a92-8b8f-79fcbf32db52 response_code = 204 uri = /vpc-routes
21742025-02-28T11:05:30.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59633
21752025-02-28T11:05:30.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59633 req_id = a9d87df2-322a-418d-83c7-e8efffcd8671 response_code = 200 uri = /v2p
21762025-02-28T11:05:30.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41673
21772025-02-28T11:05:30.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21782025-02-28T11:05:30.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21792025-02-28T11:05:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41673 req_id = 7dc6fd76-876b-4402-9b80-061c5d32fe71 response_code = 204 uri = /switch-ports
21802025-02-28T11:05:30.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41673 req_id = 5edf2838-0c3e-4793-bc4d-32754e59cca3 response_code = 200 uri = /network-bootstore-config
21812025-02-28T11:05:40.795ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7339 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = ca8ef988-1c46-4833-997e-3774abd704fc response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
21822025-02-28T11:05:41.645ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47013
21832025-02-28T11:05:41.645ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47013 req_id = 51139db5-793c-4813-9871-f31da2c29416 response_code = 200 uri = /baseboard
21842025-02-28T11:05:58.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45840
21852025-02-28T11:05:58.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45840 req_id = 9953165b-6e64-407f-a020-6cc6b54f7d9e response_code = 200 uri = /vpc-routes
21862025-02-28T11:05:59.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56852
21872025-02-28T11:05:59.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56852 req_id = 5fff059d-8bcf-4523-965c-cafbfafb7294 response_code = 200 uri = /v2p
21882025-02-28T11:05:59.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21892025-02-28T11:05:59.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45840 req_id = f4fdfe6d-1bdd-4e07-8d3c-74c730dc9261 response_code = 204 uri = /eip-gateways
21902025-02-28T11:05:59.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45840 req_id = 390dd626-b219-431a-8da8-460a0ca6b303 response_code = 204 uri = /vpc-routes
21912025-02-28T11:05:59.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61527
21922025-02-28T11:05:59.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21932025-02-28T11:05:59.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21942025-02-28T11:05:59.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61527 req_id = 1a93cb6e-4303-4d85-b069-7318a2b53000 response_code = 204 uri = /switch-ports
21952025-02-28T11:05:59.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61527 req_id = 796e921c-2659-4439-a18e-a6c52a619c98 response_code = 200 uri = /network-bootstore-config
21962025-02-28T11:06:00.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39658
21972025-02-28T11:06:00.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39658 req_id = afb13ec3-1f1a-4355-94b9-a7e9700dc80c response_code = 200 uri = /vpc-routes
21982025-02-28T11:06:00.566ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
21992025-02-28T11:06:00.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39658 req_id = 2507ea90-2967-4ba3-b813-edb178ec9ef9 response_code = 204 uri = /eip-gateways
22002025-02-28T11:06:00.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39658 req_id = 2113ff69-be9b-45f8-8e68-777b30d1612a response_code = 204 uri = /vpc-routes
22012025-02-28T11:06:00.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36695
22022025-02-28T11:06:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36695 req_id = 5ddc30a0-ef7d-4989-ab1c-befeec656989 response_code = 200 uri = /vpc-routes
22032025-02-28T11:06:00.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22042025-02-28T11:06:00.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36695 req_id = bd959ffc-d8cb-4ffb-a019-e9a0c10e3354 response_code = 204 uri = /eip-gateways
22052025-02-28T11:06:00.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53839
22062025-02-28T11:06:00.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53839 req_id = 6cf27da5-0b61-435b-905b-4ad8146800d2 response_code = 200 uri = /v2p
22072025-02-28T11:06:00.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36695 req_id = 2f149e6c-320d-446f-9ca9-cddc15608e19 response_code = 204 uri = /vpc-routes
22082025-02-28T11:06:00.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49713
22092025-02-28T11:06:00.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49713 req_id = 3bb40127-7900-41ab-9228-c1c2a10ae7a9 response_code = 200 uri = /v2p
22102025-02-28T11:06:00.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49534
22112025-02-28T11:06:00.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22122025-02-28T11:06:00.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22132025-02-28T11:06:00.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49534 req_id = e38ae5e6-1c3b-4bd2-9acf-55a9b159ec32 response_code = 204 uri = /switch-ports
22142025-02-28T11:06:00.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42269
22152025-02-28T11:06:00.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22162025-02-28T11:06:00.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49534 req_id = fed7a6ec-a63e-421b-855b-fc7d6556ca9d response_code = 200 uri = /network-bootstore-config
22172025-02-28T11:06:00.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22182025-02-28T11:06:01.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42269 req_id = 3b28921e-0e61-41ee-9034-da1ad302e865 response_code = 204 uri = /switch-ports
22192025-02-28T11:06:01.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42269 req_id = 18608a24-20e9-48c2-bcfc-30e3912be764 response_code = 200 uri = /network-bootstore-config
22202025-02-28T11:06:10.795ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7683 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 4ab772ec-6a5f-4075-bb12-4cbb09d1712c response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
22212025-02-28T11:06:11.679ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47631
22222025-02-28T11:06:11.679ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47631 req_id = 785287d2-52ff-4e41-8c7c-11d95e0b7cfe response_code = 200 uri = /baseboard
22232025-02-28T11:06:28.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41385
22242025-02-28T11:06:28.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41385 req_id = 05de1fbd-f621-44ad-9bbd-11da74ab63f9 response_code = 200 uri = /v2p
22252025-02-28T11:06:28.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41159
22262025-02-28T11:06:28.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41159 req_id = 7f9a1f37-103a-4b45-9c2a-ec8814c96c52 response_code = 200 uri = /vpc-routes
22272025-02-28T11:06:29.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22282025-02-28T11:06:29.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41159 req_id = d8f93e75-a0c9-45b2-9a57-d50370dbf3d5 response_code = 204 uri = /eip-gateways
22292025-02-28T11:06:29.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53104
22302025-02-28T11:06:29.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22312025-02-28T11:06:29.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22322025-02-28T11:06:29.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53104 req_id = 157fed6f-5078-412f-a523-b91051a890e1 response_code = 204 uri = /switch-ports
22332025-02-28T11:06:29.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41159 req_id = 2eff692a-473b-4206-ba92-3aac9be2fdab response_code = 204 uri = /vpc-routes
22342025-02-28T11:06:29.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53104 req_id = a8cdbf5c-f90e-4d9c-89d8-4562b6982d89 response_code = 200 uri = /network-bootstore-config
22352025-02-28T11:06:30.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50576
22362025-02-28T11:06:30.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50576 req_id = d63e34e0-64c7-4fd7-a3da-04fee2179c5c response_code = 200 uri = /vpc-routes
22372025-02-28T11:06:30.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37014
22382025-02-28T11:06:30.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37014 req_id = 81d58bbb-23ef-4f4a-9a30-fd7731605517 response_code = 200 uri = /v2p
22392025-02-28T11:06:30.287ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22402025-02-28T11:06:30.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50576 req_id = a3908761-159e-40aa-95ea-57486678c242 response_code = 204 uri = /eip-gateways
22412025-02-28T11:06:30.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50576 req_id = 75c441a5-c862-4875-9366-b208227a18e2 response_code = 204 uri = /vpc-routes
22422025-02-28T11:06:30.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49497
22432025-02-28T11:06:30.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22442025-02-28T11:06:30.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22452025-02-28T11:06:30.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49497 req_id = 497dcc17-012b-4741-a660-6a6e087e8640 response_code = 204 uri = /switch-ports
22462025-02-28T11:06:30.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53141
22472025-02-28T11:06:30.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53141 req_id = 79bc391a-3f54-4209-bff7-dd7a2f4f1e0b response_code = 200 uri = /vpc-routes
22482025-02-28T11:06:30.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49497 req_id = d216f029-5a03-462c-a039-2edcfbf56cb9 response_code = 200 uri = /network-bootstore-config
22492025-02-28T11:06:30.536ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22502025-02-28T11:06:30.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53141 req_id = d53dee9a-4a5e-445b-8dd4-6492198f4ff7 response_code = 204 uri = /eip-gateways
22512025-02-28T11:06:30.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41795
22522025-02-28T11:06:30.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41795 req_id = f7bc7651-0cce-4379-a65d-351b65aa3acd response_code = 200 uri = /v2p
22532025-02-28T11:06:30.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53141 req_id = 250e4e0d-a23f-48d2-836a-70507f5362e9 response_code = 204 uri = /vpc-routes
22542025-02-28T11:06:30.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43403
22552025-02-28T11:06:30.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22562025-02-28T11:06:30.748ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22572025-02-28T11:06:30.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43403 req_id = 5a9a84fc-9d9d-4758-a44a-e941a6268087 response_code = 204 uri = /switch-ports
22582025-02-28T11:06:30.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43403 req_id = 50305359-a06e-4df6-a551-64d2aef832c5 response_code = 200 uri = /network-bootstore-config
22592025-02-28T11:06:40.795ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8007 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = f8f1687e-bfcd-4c27-ab0f-771e7645fa7a response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
22602025-02-28T11:06:41.712ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54212
22612025-02-28T11:06:41.712ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54212 req_id = 8818f56e-b4ef-468f-a2ed-d7d5beab5c55 response_code = 200 uri = /baseboard
22622025-02-28T11:06:58.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41433
22632025-02-28T11:06:58.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41433 req_id = 0d54235d-0ed7-4193-bb17-2b986fc78a04 response_code = 200 uri = /vpc-routes
22642025-02-28T11:06:58.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22652025-02-28T11:06:58.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41433 req_id = 18f2f64e-578a-4b11-a361-bc066378c422 response_code = 204 uri = /eip-gateways
22662025-02-28T11:06:58.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41433 req_id = ee9ebec3-9aa6-426a-8a69-0bc423710461 response_code = 204 uri = /vpc-routes
22672025-02-28T11:06:59.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34419
22682025-02-28T11:06:59.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34419 req_id = eb2c4d48-37aa-4b80-97ec-1d4c77b04940 response_code = 200 uri = /v2p
22692025-02-28T11:06:59.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44172
22702025-02-28T11:06:59.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22712025-02-28T11:06:59.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22722025-02-28T11:06:59.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44172 req_id = 8625a386-5d2d-4658-b1f8-b1a84875f670 response_code = 204 uri = /switch-ports
22732025-02-28T11:06:59.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44172 req_id = d54ecad5-c301-44a2-9c40-2f92a86d8c5a response_code = 200 uri = /network-bootstore-config
22742025-02-28T11:07:00.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39388
22752025-02-28T11:07:00.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39388 req_id = 5ad80336-465d-42b9-afe2-c2db31ada3d7 response_code = 200 uri = /vpc-routes
22762025-02-28T11:07:00.387ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22772025-02-28T11:07:00.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39388 req_id = b2c15178-5ae7-4a8b-adeb-f15b2f86f37e response_code = 204 uri = /eip-gateways
22782025-02-28T11:07:00.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39388 req_id = a5f2b630-6e93-4fef-9fa1-97c9ee2d51f3 response_code = 204 uri = /vpc-routes
22792025-02-28T11:07:00.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61590
22802025-02-28T11:07:00.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22812025-02-28T11:07:00.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22822025-02-28T11:07:00.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61590 req_id = 8f7bd476-b77e-4b79-b9c9-c589ab1e5e46 response_code = 204 uri = /switch-ports
22832025-02-28T11:07:00.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51463
22842025-02-28T11:07:00.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51463 req_id = 42f54921-3336-417b-8e62-713944bd151d response_code = 200 uri = /v2p
22852025-02-28T11:07:00.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61590 req_id = 1cb8e958-6acd-47e5-8956-cd81640c0eaa response_code = 200 uri = /network-bootstore-config
22862025-02-28T11:07:00.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32786
22872025-02-28T11:07:00.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32786 req_id = 45c5a037-91d8-432a-9467-8b641e56cb7c response_code = 200 uri = /vpc-routes
22882025-02-28T11:07:00.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
22892025-02-28T11:07:00.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32786 req_id = f6ce5f96-d416-4512-aa5c-ceda2840cf13 response_code = 204 uri = /eip-gateways
22902025-02-28T11:07:00.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32786 req_id = 9015f06b-7bae-4a1b-a23b-a28ec8406f35 response_code = 204 uri = /vpc-routes
22912025-02-28T11:07:01.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56107
22922025-02-28T11:07:01.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22932025-02-28T11:07:01.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22942025-02-28T11:07:01.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56107 req_id = 0d0b8861-d81a-4fa9-be9c-593f3785cd5c response_code = 204 uri = /switch-ports
22952025-02-28T11:07:01.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38280
22962025-02-28T11:07:01.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38280 req_id = c903e992-b28e-4d11-b935-edf29c270bfb response_code = 200 uri = /v2p
22972025-02-28T11:07:01.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56107 req_id = 0a48cdcc-0147-49f1-ac93-8d724fcc11e5 response_code = 200 uri = /network-bootstore-config
22982025-02-28T11:07:10.796ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7587 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = eb6d2134-69ac-48a7-9686-2ab421c705e2 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
22992025-02-28T11:07:11.745ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64447
23002025-02-28T11:07:11.745ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64447 req_id = 16514836-4e6c-41ea-abf6-bad95ab88b04 response_code = 200 uri = /baseboard
23012025-02-28T11:07:28.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45268
23022025-02-28T11:07:28.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45268 req_id = 8b6e4004-47e9-4bfc-83de-fb2a4c9a1a1b response_code = 200 uri = /vpc-routes
23032025-02-28T11:07:28.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23042025-02-28T11:07:28.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45268 req_id = da2054d2-92c2-4e30-a849-b92f4539478f response_code = 204 uri = /eip-gateways
23052025-02-28T11:07:28.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45268 req_id = f836b996-66c1-440b-9aaa-78b25538dea8 response_code = 204 uri = /vpc-routes
23062025-02-28T11:07:28.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53817
23072025-02-28T11:07:28.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23082025-02-28T11:07:28.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23092025-02-28T11:07:29.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97835 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53817 req_id = f6d4aec7-d96a-4641-abcc-7163b614516a response_code = 204 uri = /switch-ports
23102025-02-28T11:07:29.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46351
23112025-02-28T11:07:29.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46351 req_id = 710b1d5e-13b8-4c80-8509-44b056fb722d response_code = 200 uri = /v2p
23122025-02-28T11:07:29.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53817 req_id = 15ae01cd-ef58-4c82-a17a-c321cd6546eb response_code = 200 uri = /network-bootstore-config
23132025-02-28T11:07:30.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60743
23142025-02-28T11:07:30.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60743 req_id = 5d509b2a-0ad9-4a3d-9981-a31680fd91bc response_code = 200 uri = /vpc-routes
23152025-02-28T11:07:30.304ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23162025-02-28T11:07:30.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60743 req_id = 32c9de94-e19c-4ae6-b37d-3f2f9fe07bac response_code = 204 uri = /eip-gateways
23172025-02-28T11:07:30.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60743 req_id = 0a4ec174-cf53-49e6-bfeb-2d0a98f31020 response_code = 204 uri = /vpc-routes
23182025-02-28T11:07:30.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45617
23192025-02-28T11:07:30.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45617 req_id = bb08b6d9-bd0a-4c6c-ba34-6153723ab8f6 response_code = 200 uri = /v2p
23202025-02-28T11:07:30.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51572
23212025-02-28T11:07:30.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23222025-02-28T11:07:30.492ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23232025-02-28T11:07:30.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36042
23242025-02-28T11:07:30.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36042 req_id = 6feab8df-f416-46a7-9ecf-b3b810bb0106 response_code = 200 uri = /vpc-routes
23252025-02-28T11:07:30.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114346 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51572 req_id = 84e96b8b-13aa-43f9-83ca-322ef70dea6c response_code = 204 uri = /switch-ports
23262025-02-28T11:07:30.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51572 req_id = d1c06bbe-d183-4f59-a6d7-ae1fb5b2ee4c response_code = 200 uri = /network-bootstore-config
23272025-02-28T11:07:30.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39160
23282025-02-28T11:07:30.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23292025-02-28T11:07:30.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36042 req_id = d7779df5-981b-4988-9dba-bb4b12cb5c91 response_code = 204 uri = /eip-gateways
23302025-02-28T11:07:30.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23312025-02-28T11:07:30.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36042 req_id = 6d35b878-96d5-4924-ba62-70c0f2015b2d response_code = 204 uri = /vpc-routes
23322025-02-28T11:07:30.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23332025-02-28T11:07:30.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39160 req_id = a6369f50-4232-46d7-9b9e-58ab31622d0e response_code = 204 uri = /switch-ports
23342025-02-28T11:07:30.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39160 req_id = 5c0eff11-7b44-451a-832d-316b274fd432 response_code = 200 uri = /network-bootstore-config
23352025-02-28T11:07:30.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57508
23362025-02-28T11:07:30.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57508 req_id = 719ae7af-9ccf-4fce-9052-75ca38750268 response_code = 200 uri = /v2p
23372025-02-28T11:07:35.264ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23382025-02-28T11:07:35.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23392025-02-28T11:07:35.293ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3637, tv_nsec: 192063487 } time_to_next_cleanup = 599.99999616s
23402025-02-28T11:07:40.796ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8194 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 56f6df23-0d27-43cf-b38c-864b02f3017a response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
23412025-02-28T11:07:41.779ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41286
23422025-02-28T11:07:41.779ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41286 req_id = 31ee5a4b-cb55-4f98-8bf0-17725d45425a response_code = 200 uri = /baseboard
23432025-02-28T11:07:49.482ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23442025-02-28T11:07:58.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52159
23452025-02-28T11:07:58.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52159 req_id = 753f6276-6465-449e-b4b8-58f428900886 response_code = 200 uri = /vpc-routes
23462025-02-28T11:07:59.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53922
23472025-02-28T11:07:59.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53922 req_id = 90a24f41-8115-4dcb-adb1-313f6f006bdf response_code = 200 uri = /v2p
23482025-02-28T11:07:59.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23492025-02-28T11:07:59.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52159 req_id = 809ff428-68da-479d-a0f7-fc1967389255 response_code = 204 uri = /eip-gateways
23502025-02-28T11:07:59.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52159 req_id = 1e71ef13-a673-492d-b2d1-9332e7117046 response_code = 204 uri = /vpc-routes
23512025-02-28T11:07:59.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35656
23522025-02-28T11:07:59.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23532025-02-28T11:07:59.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23542025-02-28T11:07:59.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92524 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35656 req_id = 04dfb959-d305-49b6-8b96-55f8496d59cf response_code = 204 uri = /switch-ports
23552025-02-28T11:07:59.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35656 req_id = 8ba02e09-284f-4bb8-8382-9758d8992893 response_code = 200 uri = /network-bootstore-config
23562025-02-28T11:08:00.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40849
23572025-02-28T11:08:00.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40849 req_id = 4eea2a8a-7516-460d-b441-26e4b9799602 response_code = 200 uri = /vpc-routes
23582025-02-28T11:08:00.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23592025-02-28T11:08:00.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40849 req_id = 5fe1735b-0547-49e8-be58-b68872246af3 response_code = 204 uri = /eip-gateways
23602025-02-28T11:08:00.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52863
23612025-02-28T11:08:00.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52863 req_id = d4ef9fb0-537d-4876-b248-49ce6b921206 response_code = 200 uri = /v2p
23622025-02-28T11:08:00.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40849 req_id = f41069aa-adc5-4719-bc31-6d55c7c761b3 response_code = 204 uri = /vpc-routes
23632025-02-28T11:08:00.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33485
23642025-02-28T11:08:00.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23652025-02-28T11:08:00.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23662025-02-28T11:08:00.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33485 req_id = 2e88ac8d-35f2-421a-ab49-22a222697893 response_code = 204 uri = /switch-ports
23672025-02-28T11:08:00.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45593
23682025-02-28T11:08:00.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45593 req_id = 8d936cb1-fc91-481f-90e6-8108f95fe3e2 response_code = 200 uri = /vpc-routes
23692025-02-28T11:08:00.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33485 req_id = c55da2cf-09ed-4d5e-8281-5011174059c6 response_code = 200 uri = /network-bootstore-config
23702025-02-28T11:08:00.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23712025-02-28T11:08:00.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45593 req_id = 0048d859-79b0-4443-9b05-c38d02c6bee5 response_code = 204 uri = /eip-gateways
23722025-02-28T11:08:00.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45593 req_id = 66c5d0b3-f748-4555-b4e1-ad0c53693c08 response_code = 204 uri = /vpc-routes
23732025-02-28T11:08:00.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45828
23742025-02-28T11:08:00.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45828 req_id = 2cd39f64-d09f-4f76-a3b6-817b8e46b879 response_code = 200 uri = /v2p
23752025-02-28T11:08:00.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36748
23762025-02-28T11:08:00.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23772025-02-28T11:08:00.991ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23782025-02-28T11:08:01.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36748 req_id = d72d54e0-df4c-436a-9a26-81b45dccff38 response_code = 204 uri = /switch-ports
23792025-02-28T11:08:01.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36748 req_id = 58be34ea-1e7f-4e2b-a3ae-4bc32b585d46 response_code = 200 uri = /network-bootstore-config
23802025-02-28T11:08:10.797ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8262 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 14ab50e3-e672-4b46-bdfe-33512538cefa response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
23812025-02-28T11:08:11.812ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63344
23822025-02-28T11:08:11.812ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63344 req_id = 287a3ccb-19ea-4fb5-8d0a-33b127f96739 response_code = 200 uri = /baseboard
23832025-02-28T11:08:28.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36983
23842025-02-28T11:08:28.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36983 req_id = 87f91aa5-d220-4d6b-9595-1eb2b7fb31bc response_code = 200 uri = /vpc-routes
23852025-02-28T11:08:28.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23862025-02-28T11:08:28.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36983 req_id = 8095aa5a-cf98-49ca-b1ba-93cce5a8b763 response_code = 204 uri = /eip-gateways
23872025-02-28T11:08:28.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36983 req_id = e3996687-a0c5-439a-a909-14b1c69ce4fb response_code = 204 uri = /vpc-routes
23882025-02-28T11:08:28.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35185
23892025-02-28T11:08:28.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23902025-02-28T11:08:28.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23912025-02-28T11:08:29.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35185 req_id = d6a8f0c4-a598-4763-995e-374998358c01 response_code = 204 uri = /switch-ports
23922025-02-28T11:08:29.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49555
23932025-02-28T11:08:29.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49555 req_id = c4378c9d-d529-4132-b703-c3e42bc21995 response_code = 200 uri = /v2p
23942025-02-28T11:08:29.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35185 req_id = 42172f3f-2818-41b2-8c07-053b5aef44e8 response_code = 200 uri = /network-bootstore-config
23952025-02-28T11:08:30.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48067
23962025-02-28T11:08:30.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48067 req_id = 73e168b7-edcf-4010-9eb8-b5c252bf55e1 response_code = 200 uri = /vpc-routes
23972025-02-28T11:08:30.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
23982025-02-28T11:08:30.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48067 req_id = 0098b7f8-5a11-4b6d-912e-a17a65631099 response_code = 204 uri = /eip-gateways
23992025-02-28T11:08:30.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65432
24002025-02-28T11:08:30.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65432 req_id = 4efd753c-8f45-4cc6-956b-68f6bc250f39 response_code = 200 uri = /v2p
24012025-02-28T11:08:30.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48067 req_id = 083ea862-c6bb-4146-88d5-f067f04696a7 response_code = 204 uri = /vpc-routes
24022025-02-28T11:08:30.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51658
24032025-02-28T11:08:30.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24042025-02-28T11:08:30.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24052025-02-28T11:08:30.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51658 req_id = 0a8b34ad-47dc-4479-b825-d177f8f0ec0e response_code = 204 uri = /switch-ports
24062025-02-28T11:08:30.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51658 req_id = 44392588-f1fd-4855-9832-ce1cabe0f6b4 response_code = 200 uri = /network-bootstore-config
24072025-02-28T11:08:30.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53536
24082025-02-28T11:08:30.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53536 req_id = 70b9e52c-216c-4620-b480-981df8c1c315 response_code = 200 uri = /vpc-routes
24092025-02-28T11:08:30.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24102025-02-28T11:08:30.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53536 req_id = 05aedcba-0c87-4d46-9c03-b61907faa66c response_code = 204 uri = /eip-gateways
24112025-02-28T11:08:30.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53536 req_id = 4c3c748d-4fde-4bfa-8bbd-70c3cba99dea response_code = 204 uri = /vpc-routes
24122025-02-28T11:08:30.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52261
24132025-02-28T11:08:30.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52261 req_id = fe2ffa13-dd81-4f42-90b3-14e802d74989 response_code = 200 uri = /v2p
24142025-02-28T11:08:30.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43921
24152025-02-28T11:08:30.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24162025-02-28T11:08:30.887ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24172025-02-28T11:08:30.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43921 req_id = 8db9e3ce-1991-4f9b-b69a-2bd87fe24ade response_code = 204 uri = /switch-ports
24182025-02-28T11:08:30.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43921 req_id = a6602c42-5dff-4a9a-8d9c-1f785a50aa79 response_code = 200 uri = /network-bootstore-config
24192025-02-28T11:08:40.795ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6968 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 50519a07-1f92-46e6-9928-197e8471dd1c response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
24202025-02-28T11:08:41.847ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53478
24212025-02-28T11:08:41.847ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53478 req_id = 1d29496f-6212-47d1-962c-e1f5045090b8 response_code = 200 uri = /baseboard
24222025-02-28T11:08:58.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45328
24232025-02-28T11:08:58.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45328 req_id = 6008bf33-05b1-4c9d-ab70-480011cb9b44 response_code = 200 uri = /vpc-routes
24242025-02-28T11:08:58.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24252025-02-28T11:08:58.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45328 req_id = b8753788-bc73-4071-ae4f-1c1839c9b082 response_code = 204 uri = /eip-gateways
24262025-02-28T11:08:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45328 req_id = a10ae19d-095a-47b1-986f-04ccf47b3d0d response_code = 204 uri = /vpc-routes
24272025-02-28T11:08:59.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58395
24282025-02-28T11:08:59.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58395 req_id = 4f7bcb26-7e82-487f-b383-112f7757766d response_code = 200 uri = /v2p
24292025-02-28T11:08:59.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52563
24302025-02-28T11:08:59.142ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24312025-02-28T11:08:59.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24322025-02-28T11:08:59.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52563 req_id = 188683e5-6b9a-418a-9bfa-5b5db3335fef response_code = 204 uri = /switch-ports
24332025-02-28T11:08:59.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52563 req_id = d3023c10-3cdc-4689-ad54-2d7ee3b762b9 response_code = 200 uri = /network-bootstore-config
24342025-02-28T11:09:00.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35486
24352025-02-28T11:09:00.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35486 req_id = 808d3ea1-b0c1-49ed-be32-8fe90dc070fe response_code = 200 uri = /vpc-routes
24362025-02-28T11:09:00.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24372025-02-28T11:09:00.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35486 req_id = fa2a11ee-51c6-479d-92f2-cbaaa66b087a response_code = 204 uri = /eip-gateways
24382025-02-28T11:09:00.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35486 req_id = bb403228-b753-4e0e-a1ef-7f3da9cf36ae response_code = 204 uri = /vpc-routes
24392025-02-28T11:09:00.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50063
24402025-02-28T11:09:00.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50063 req_id = 6d494561-8f60-44dc-b2e7-093bf075a8c7 response_code = 200 uri = /v2p
24412025-02-28T11:09:00.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45732
24422025-02-28T11:09:00.584ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24432025-02-28T11:09:00.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24442025-02-28T11:09:00.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45732 req_id = b439eb24-fbfa-4846-90f4-dec0ffba7ebe response_code = 204 uri = /switch-ports
24452025-02-28T11:09:00.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45339
24462025-02-28T11:09:00.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45339 req_id = c687a437-e338-4fd2-b210-4cfd992b3d99 response_code = 200 uri = /vpc-routes
24472025-02-28T11:09:00.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45732 req_id = fe84e58e-798a-4892-a563-e8c6d6c4d9a5 response_code = 200 uri = /network-bootstore-config
24482025-02-28T11:09:00.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24492025-02-28T11:09:00.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45339 req_id = bdc64fb2-1288-4949-9559-feb5b57e7327 response_code = 204 uri = /eip-gateways
24502025-02-28T11:09:00.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45339 req_id = 9a917bfc-62aa-433d-b19b-f16ada04c8da response_code = 204 uri = /vpc-routes
24512025-02-28T11:09:00.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52104
24522025-02-28T11:09:00.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52104 req_id = 151b488f-8142-4107-8330-46dee6f78ba5 response_code = 200 uri = /v2p
24532025-02-28T11:09:00.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49164
24542025-02-28T11:09:00.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24552025-02-28T11:09:00.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24562025-02-28T11:09:00.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49164 req_id = f7458692-2157-4175-bda9-4bc21605fe82 response_code = 204 uri = /switch-ports
24572025-02-28T11:09:00.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49164 req_id = bb3b1b1e-3cf6-44bd-96dc-8b5df4b1e8f2 response_code = 200 uri = /network-bootstore-config
24582025-02-28T11:09:10.798ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8200 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 49d4b4be-74c4-44fb-a32f-eaf1d582a4dd response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
24592025-02-28T11:09:11.879ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45661
24602025-02-28T11:09:11.879ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45661 req_id = 988953c9-53fa-42aa-b97a-7499ad9f44d0 response_code = 200 uri = /baseboard
24612025-02-28T11:09:28.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34430
24622025-02-28T11:09:28.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34430 req_id = 5692fba9-2587-44f5-bddd-79e869ec62bc response_code = 200 uri = /vpc-routes
24632025-02-28T11:09:28.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24642025-02-28T11:09:28.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34430 req_id = 4710c494-4ef4-4b84-8a93-a5fc08f44eba response_code = 204 uri = /eip-gateways
24652025-02-28T11:09:28.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34430 req_id = af8c55f7-4319-49b2-a7ee-925cdba296da response_code = 204 uri = /vpc-routes
24662025-02-28T11:09:28.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56428
24672025-02-28T11:09:28.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24682025-02-28T11:09:28.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24692025-02-28T11:09:29.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56428 req_id = b5348924-5632-4b13-9ccb-afd5676d9d14 response_code = 204 uri = /switch-ports
24702025-02-28T11:09:29.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56428 req_id = 6c4fa8f2-cf9a-494c-8bac-3251f680ce3e response_code = 200 uri = /network-bootstore-config
24712025-02-28T11:09:29.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54992
24722025-02-28T11:09:29.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54992 req_id = 760a8212-f611-4f4c-98f1-1fd5b1834e35 response_code = 200 uri = /v2p
24732025-02-28T11:09:30.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42806
24742025-02-28T11:09:30.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42806 req_id = f73ec834-2d02-4906-9003-f543d7d815c6 response_code = 200 uri = /vpc-routes
24752025-02-28T11:09:30.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24762025-02-28T11:09:30.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42806 req_id = 025eec9b-a62d-48f2-82e0-95d891adb9b8 response_code = 204 uri = /eip-gateways
24772025-02-28T11:09:30.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42806 req_id = 41016972-f7d0-46e2-b905-4832538b3bd9 response_code = 204 uri = /vpc-routes
24782025-02-28T11:09:30.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35619
24792025-02-28T11:09:30.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35619 req_id = 8ed88448-dffb-4110-a6fc-c1003518aba1 response_code = 200 uri = /v2p
24802025-02-28T11:09:30.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53836
24812025-02-28T11:09:30.406ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24822025-02-28T11:09:30.456ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24832025-02-28T11:09:30.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53836 req_id = 6d17b881-6d2c-41df-a53f-4a19e62fc010 response_code = 204 uri = /switch-ports
24842025-02-28T11:09:30.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53836 req_id = 2f861056-40e3-4bbd-94c4-e2ed89698c70 response_code = 200 uri = /network-bootstore-config
24852025-02-28T11:09:30.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40517
24862025-02-28T11:09:30.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40517 req_id = 577d9841-8f84-458c-813a-3d46f9fd3a24 response_code = 200 uri = /vpc-routes
24872025-02-28T11:09:30.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
24882025-02-28T11:09:30.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40517 req_id = 7e95cf7c-a630-4408-9b18-e04592993cf4 response_code = 204 uri = /eip-gateways
24892025-02-28T11:09:30.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40517 req_id = 40af6ecb-c5c9-4b88-90c5-c1afdeee1a7f response_code = 204 uri = /vpc-routes
24902025-02-28T11:09:30.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60123
24912025-02-28T11:09:30.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24922025-02-28T11:09:30.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24932025-02-28T11:09:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60123 req_id = f2c61de0-1a51-4530-91b8-77be7a178554 response_code = 204 uri = /switch-ports
24942025-02-28T11:09:30.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37199
24952025-02-28T11:09:30.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37199 req_id = 9a0cdb70-07c1-4005-ae30-487874ea2ecf response_code = 200 uri = /v2p
24962025-02-28T11:09:30.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60123 req_id = 5a2dddbb-54c2-4d87-bd4e-85322c47d687 response_code = 200 uri = /network-bootstore-config
24972025-02-28T11:09:40.797ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8021 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = f6e258fd-4d5d-4ab1-a1ac-ab708624a4d3 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
24982025-02-28T11:09:41.912ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47567
24992025-02-28T11:09:41.912ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47567 req_id = f8d1d492-9aa8-45ad-a389-920798d5033c response_code = 200 uri = /baseboard
25002025-02-28T11:09:59.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34031
25012025-02-28T11:09:59.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34031 req_id = 8d00c337-3862-4f6c-9727-aeb347547c6d response_code = 200 uri = /vpc-routes
25022025-02-28T11:09:59.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51975
25032025-02-28T11:09:59.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25042025-02-28T11:09:59.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51975 req_id = 4d485874-c67f-47eb-96a7-d7ca75a6e679 response_code = 200 uri = /artifacts
25052025-02-28T11:09:59.222ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
25062025-02-28T11:09:59.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34031 req_id = fc477cfd-8527-46d1-b3fa-ad3dc2d1e08a response_code = 204 uri = /eip-gateways
25072025-02-28T11:09:59.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34031 req_id = f06a80c8-2295-4cf0-8b07-8ccbd58bbde2 response_code = 204 uri = /vpc-routes
25082025-02-28T11:09:59.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52149
25092025-02-28T11:09:59.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25102025-02-28T11:09:59.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25112025-02-28T11:09:59.345ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
25122025-02-28T11:09:59.346ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
25132025-02-28T11:09:59.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46580
25142025-02-28T11:09:59.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46580 req_id = 13d95597-4136-40b1-a6a3-382b697a5139 response_code = 200 uri = /v2p
25152025-02-28T11:09:59.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25162025-02-28T11:09:59.361ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd
25172025-02-28T11:09:59.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36347
25182025-02-28T11:09:59.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25192025-02-28T11:09:59.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25202025-02-28T11:09:59.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_198de296-2120-47e0-aaa7-ce837077a9bd
25212025-02-28T11:09:59.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25222025-02-28T11:09:59.412ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25232025-02-28T11:09:59.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3
25242025-02-28T11:09:59.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25252025-02-28T11:09:59.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3c8d4110-32ba-46e1-8821-6881348da454
25262025-02-28T11:09:59.461ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25272025-02-28T11:09:59.461ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e
25282025-02-28T11:09:59.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36347 req_id = 571cdc78-9eb9-41fa-9969-25e666e2fe3e response_code = 204 uri = /switch-ports
25292025-02-28T11:09:59.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36347 req_id = f3db9fec-a063-4adb-a887-1223ab49365f response_code = 200 uri = /network-bootstore-config
25302025-02-28T11:09:59.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25312025-02-28T11:09:59.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf
25322025-02-28T11:09:59.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25332025-02-28T11:09:59.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c223d649-aefc-4563-b832-624daf4863fe
25342025-02-28T11:09:59.528ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25352025-02-28T11:09:59.528ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_191404b5-bb5f-4942-aade-4f02119d69b0
25362025-02-28T11:09:59.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25372025-02-28T11:09:59.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75
25382025-02-28T11:09:59.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52149 req_id = 908ff7f4-aa42-4751-897e-e3b7ab9ee999 response_code = 200 uri = /inventory
25392025-02-28T11:09:59.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39827
25402025-02-28T11:09:59.656ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25412025-02-28T11:09:59.656ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25422025-02-28T11:09:59.656ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25432025-02-28T11:09:59.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25442025-02-28T11:09:59.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25452025-02-28T11:09:59.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25462025-02-28T11:09:59.657ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472025-02-28T11:09:59.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39827 req_id = 4fd729da-549d-4a2b-948f-17a640e9701c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25482025-02-28T11:10:00.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62661
25492025-02-28T11:10:00.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62661 req_id = 06d9f22d-e446-4e58-8f3b-06fb5e0e1ee0 response_code = 200 uri = /vpc-routes
25502025-02-28T11:10:00.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64857
25512025-02-28T11:10:00.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25522025-02-28T11:10:00.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64857 req_id = 00634f06-f0e3-4d31-8760-f859ba0f4b6e response_code = 200 uri = /artifacts
25532025-02-28T11:10:00.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
25542025-02-28T11:10:00.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62661 req_id = 34bfaf24-b50e-4700-b22b-b12d2f89995b response_code = 204 uri = /eip-gateways
25552025-02-28T11:10:00.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62661 req_id = 9fb666cf-970a-4697-a533-fe9b44fb8e52 response_code = 204 uri = /vpc-routes
25562025-02-28T11:10:00.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60282
25572025-02-28T11:10:00.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60282 req_id = c86ce16e-2171-4616-8719-21364c00311f response_code = 200 uri = /v2p
25582025-02-28T11:10:00.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47826
25592025-02-28T11:10:00.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25602025-02-28T11:10:00.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25612025-02-28T11:10:00.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
25622025-02-28T11:10:00.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
25632025-02-28T11:10:00.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48912
25642025-02-28T11:10:00.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25652025-02-28T11:10:00.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25662025-02-28T11:10:00.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd
25672025-02-28T11:10:00.770ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25682025-02-28T11:10:00.770ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_198de296-2120-47e0-aaa7-ce837077a9bd
25692025-02-28T11:10:00.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25702025-02-28T11:10:00.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25712025-02-28T11:10:00.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3
25722025-02-28T11:10:00.821ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25732025-02-28T11:10:00.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3c8d4110-32ba-46e1-8821-6881348da454
25742025-02-28T11:10:00.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48912 req_id = 0712f830-67d5-4bf3-b51c-72d27d1e0e8b response_code = 204 uri = /switch-ports
25752025-02-28T11:10:00.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48912 req_id = 071a4eea-0ddf-498a-bda5-0c7e758bf2fa response_code = 200 uri = /network-bootstore-config
25762025-02-28T11:10:00.853ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25772025-02-28T11:10:00.853ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e
25782025-02-28T11:10:00.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42248
25792025-02-28T11:10:00.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42248 req_id = 6f1af654-af4b-4a49-95d6-9934237bfed9 response_code = 200 uri = /vpc-routes
25802025-02-28T11:10:00.880ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25812025-02-28T11:10:00.880ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf
25822025-02-28T11:10:00.906ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25832025-02-28T11:10:00.906ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c223d649-aefc-4563-b832-624daf4863fe
25842025-02-28T11:10:00.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35341
25852025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25862025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25872025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25882025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25892025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25902025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25912025-02-28T11:10:00.925ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25922025-02-28T11:10:00.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 904 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35341 req_id = 9242f7e3-68b7-41f2-b033-5ddc0066cd73 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25932025-02-28T11:10:00.931ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25942025-02-28T11:10:00.931ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_191404b5-bb5f-4942-aade-4f02119d69b0
25952025-02-28T11:10:00.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57961
25962025-02-28T11:10:00.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
25972025-02-28T11:10:00.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42248 req_id = da357261-7567-4dfd-8639-fbcae8ca9d91 response_code = 204 uri = /eip-gateways
25982025-02-28T11:10:00.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25992025-02-28T11:10:00.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 16647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57961 req_id = 5b3eac8d-086e-424a-9103-2be1dbb439f9 response_code = 200 uri = /artifacts
26002025-02-28T11:10:00.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42248 req_id = d3b6f454-d4d2-4e0d-bb5a-9ed1ad78e223 response_code = 204 uri = /vpc-routes
26012025-02-28T11:10:00.958ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26022025-02-28T11:10:00.958ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75
26032025-02-28T11:10:00.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47826 req_id = 87568d69-8e14-40bd-9669-da9422d9d9f1 response_code = 200 uri = /inventory
26042025-02-28T11:10:01.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60477
26052025-02-28T11:10:01.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26062025-02-28T11:10:01.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26072025-02-28T11:10:01.084ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/config/omicron-zones.json file = common/src/ledger.rs:177
26082025-02-28T11:10:01.085ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/config/omicron-zones.json file = common/src/ledger.rs:177
26092025-02-28T11:10:01.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63695
26102025-02-28T11:10:01.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63695 req_id = ac122ee3-084e-4bb4-a9af-e0fe34445aba response_code = 200 uri = /v2p
26112025-02-28T11:10:01.099ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7d5a9c4-cb15-48f9-b917-417a6c7f99dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122025-02-28T11:10:01.099ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7d5a9c4-cb15-48f9-b917-417a6c7f99dd
26132025-02-28T11:10:01.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 198de296-2120-47e0-aaa7-ce837077a9bd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26142025-02-28T11:10:01.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_198de296-2120-47e0-aaa7-ce837077a9bd
26152025-02-28T11:10:01.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35812
26162025-02-28T11:10:01.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26172025-02-28T11:10:01.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36d3c3e4-af57-409f-868d-1af0fe9ba6b3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-02-28T11:10:01.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36d3c3e4-af57-409f-868d-1af0fe9ba6b3
26192025-02-28T11:10:01.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c8d4110-32ba-46e1-8821-6881348da454 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26202025-02-28T11:10:01.183ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3c8d4110-32ba-46e1-8821-6881348da454
26212025-02-28T11:10:01.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26222025-02-28T11:10:01.210ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a657f38-eded-4dc9-98a4-74fdac1ff02e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232025-02-28T11:10:01.211ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3a657f38-eded-4dc9-98a4-74fdac1ff02e
26242025-02-28T11:10:01.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252025-02-28T11:10:01.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf
26262025-02-28T11:10:01.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35812 req_id = 09dd92a0-995b-49b8-8577-7fc76149b775 response_code = 204 uri = /switch-ports
26272025-02-28T11:10:01.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35812 req_id = a793b158-8fbc-4d9f-b797-034be722c76c response_code = 200 uri = /network-bootstore-config
26282025-02-28T11:10:01.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c223d649-aefc-4563-b832-624daf4863fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-02-28T11:10:01.276ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c223d649-aefc-4563-b832-624daf4863fe
26302025-02-28T11:10:01.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48717
26312025-02-28T11:10:01.287ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b53f5a6-8160-4c75-9f48-f88afdaf6963, kind: Service { id: 0af75e4f-3314-468e-b1a8-ef13556995ea }, name: Name("external-dns-0af75e4f-3314-468e-b1a8-ef13556995ea"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 4])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba435c4f-134e-49ba-a772-143128ae4f3e, kind: Service { id: a6ff5684-7d89-4a32-84ad-85950845bdf2 }, name: Name("external-dns-a6ff5684-7d89-4a32-84ad-85950845bdf2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2629aecf-412b-4944-90e3-a617dd108dc8, kind: Service { id: 74f1547b-a833-4952-b80e-4986ebf8427a }, name: Name("nexus-74f1547b-a833-4952-b80e-4986ebf8427a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 11])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 326a670e-bcd8-4b5e-9508-05229fb10c8e, kind: Service { id: d72a02ec-7939-4df2-9449-a9fb85ed7ae8 }, name: Name("nexus-d72a02ec-7939-4df2-9449-a9fb85ed7ae8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd80c8d8-7412-46da-8600-e2a67f126885, kind: Service { id: 80b2977d-cb89-4acf-9305-fe891d3444ad }, name: Name("nexus-80b2977d-cb89-4acf-9305-fe891d3444ad"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26322025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26332025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26342025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26352025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26362025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26372025-02-28T11:10:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26382025-02-28T11:10:01.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 451 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48717 req_id = f7c98ab2-b7b2-486f-8b42-0323e6d7a947 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26392025-02-28T11:10:01.299ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 191404b5-bb5f-4942-aade-4f02119d69b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26402025-02-28T11:10:01.299ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_191404b5-bb5f-4942-aade-4f02119d69b0
26412025-02-28T11:10:01.319ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2769f49-088a-46d9-97a0-ae743e3e4e75 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26422025-02-28T11:10:01.319ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e2769f49-088a-46d9-97a0-ae743e3e4e75
26432025-02-28T11:10:01.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60477 req_id = 2db3cf99-9170-4c69-b27c-6bf3b3b9c254 response_code = 200 uri = /inventory
26442025-02-28T11:10:10.798ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7599 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 96d872ac-af45-4e61-b86d-81cdc0bfee87 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
26452025-02-28T11:10:11.950ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50543
26462025-02-28T11:10:11.950ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50543 req_id = 64c06666-ab93-48af-b264-fb54a8e231ce response_code = 200 uri = /baseboard
26472025-02-28T11:10:28.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60451
26482025-02-28T11:10:28.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60451 req_id = 670c2903-7316-4c84-aaff-95de63c224ca response_code = 200 uri = /vpc-routes
26492025-02-28T11:10:28.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
26502025-02-28T11:10:28.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60451 req_id = f8086df8-aef5-4de5-9b1f-978f9c113d42 response_code = 204 uri = /eip-gateways
26512025-02-28T11:10:28.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40181
26522025-02-28T11:10:28.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40181 req_id = 625f49eb-d655-402e-a7ff-2ad9144157a1 response_code = 200 uri = /v2p
26532025-02-28T11:10:28.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60451 req_id = c51d26dc-85dd-40ef-9663-224051a67680 response_code = 204 uri = /vpc-routes
26542025-02-28T11:10:28.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43222
26552025-02-28T11:10:28.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26562025-02-28T11:10:28.969ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26572025-02-28T11:10:29.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43222 req_id = 37c57244-1db2-4f5d-929d-f3e03bcb0612 response_code = 204 uri = /switch-ports
26582025-02-28T11:10:29.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43222 req_id = f36827a0-c906-4258-91ee-3f2d39c2f0be response_code = 200 uri = /network-bootstore-config
26592025-02-28T11:10:30.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40213
26602025-02-28T11:10:30.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40213 req_id = 7c9613d3-170b-4811-8d2d-23e4854b939b response_code = 200 uri = /vpc-routes
26612025-02-28T11:10:30.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39817
26622025-02-28T11:10:30.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39817 req_id = 08915a44-34e4-4173-8302-79c64c96c3b3 response_code = 200 uri = /v2p
26632025-02-28T11:10:30.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
26642025-02-28T11:10:30.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40213 req_id = ef1d68b0-8a75-401a-b905-300fe4ea39f3 response_code = 204 uri = /eip-gateways
26652025-02-28T11:10:30.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40213 req_id = 2613b118-f8a5-47b5-bc9e-1e197308ec6a response_code = 204 uri = /vpc-routes
26662025-02-28T11:10:30.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61977
26672025-02-28T11:10:30.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26682025-02-28T11:10:30.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26692025-02-28T11:10:30.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61977 req_id = 07e0624a-3250-43c4-9ec3-e6f0bd482cff response_code = 204 uri = /switch-ports
26702025-02-28T11:10:30.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61977 req_id = 1bde071b-8191-42e6-9002-b5ccdc1820cb response_code = 200 uri = /network-bootstore-config
26712025-02-28T11:10:30.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46717
26722025-02-28T11:10:30.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46717 req_id = 736aecf8-0982-48fd-b144-fa9a2726aa1c response_code = 200 uri = /vpc-routes
26732025-02-28T11:10:30.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
26742025-02-28T11:10:30.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46717 req_id = c4ea4ec4-3aba-49d4-a10a-4bc2f9dd2b07 response_code = 204 uri = /eip-gateways
26752025-02-28T11:10:30.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46717 req_id = 13e3e7a4-b283-482c-b7b8-7c5bed5bb417 response_code = 204 uri = /vpc-routes
26762025-02-28T11:10:30.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35059
26772025-02-28T11:10:30.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35059 req_id = 68ca5f8b-227e-4f4c-891d-c093205f2f7b response_code = 200 uri = /v2p
26782025-02-28T11:10:30.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38909
26792025-02-28T11:10:30.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26802025-02-28T11:10:30.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26812025-02-28T11:10:30.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38909 req_id = 5e54bebf-c698-4276-889d-565f20c844a3 response_code = 204 uri = /switch-ports
26822025-02-28T11:10:30.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38909 req_id = d04c68c1-1bfb-4998-b513-9b937ca9eedb response_code = 200 uri = /network-bootstore-config
26832025-02-28T11:10:40.798ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8056 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = b25872df-5701-4924-a34b-1f71ac4979e4 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
26842025-02-28T11:10:41.985ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43210
26852025-02-28T11:10:41.986ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43210 req_id = 846f756a-522c-4e17-84f9-375157d289c0 response_code = 200 uri = /baseboard
26862025-02-28T11:10:55.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51619
26872025-02-28T11:10:55.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51619 req_id = e4f741fc-188d-4cae-a14d-18d51f619c3c response_code = 200 uri = /v2p
26882025-02-28T11:10:55.635ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15171437) }
26892025-02-28T11:10:55.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51619 req_id = fc213466-c4a3-4081-95f7-c392eafb4c10 response_code = 204 uri = /v2p
26902025-02-28T11:10:55.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40822
26912025-02-28T11:10:55.779ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15171437))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 26d2fe86-b9ac-4812-9ccf-a13638c2489b, slot: 0, read_only: false, vcr_json: .., name: "disk-6c817c4f281" }], boot_settings: Some(InstanceBootSettings { order: [26d2fe86-b9ac-4812-9ccf-a13638c2489b] }), cloud_init_bytes: Some(..) } instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a metadata = InstanceMetadata { silo_id: c56764a4-0e43-419b-af1a-3a09d1be060c, project_id: 29b07c79-7337-4eaa-9ffc-37f78c8c4154 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T11:10:55.774314862Z }
26922025-02-28T11:10:55.779ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a migration_id = None propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
26932025-02-28T11:10:55.779ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a migration_id = None propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15171437))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1692cf8-ea8a-458d-b54c-9c1fe540a7ab, kind: Instance { id: 7c8e94fb-4077-4547-92cb-05e8f0c2107a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15171437), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 26d2fe86-b9ac-4812-9ccf-a13638c2489b, slot: 0, read_only: false, vcr_json: .., name: "disk-6c817c4f281" }], boot_settings: Some(InstanceBootSettings { order: [26d2fe86-b9ac-4812-9ccf-a13638c2489b] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T11:10:55.774314862Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26942025-02-28T11:10:55.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40822 req_id = d2e4cce8-0313-466f-b705-3bd202df18f6 response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87
26952025-02-28T11:10:55.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52956
26962025-02-28T11:10:55.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52956 req_id = c05d7878-4138-49c4-a91a-67fc469e315a response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87/state
26972025-02-28T11:10:55.858ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 15171437 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26982025-02-28T11:10:55.858ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26992025-02-28T11:10:55.899ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87 file = illumos-utils/src/zone.rs:325 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27002025-02-28T11:10:55.920ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87 file = illumos-utils/src/zone.rs:363 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27012025-02-28T11:10:55.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45154
27022025-02-28T11:10:55.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45154 req_id = ed209a1f-dd1a-42bf-9ebf-9e2f1cae1f68 response_code = 200 uri = /vpc-routes
27032025-02-28T11:10:55.983ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {b1692cf8-ea8a-458d-b54c-9c1fe540a7ab: {10.151.2.175: {79dcc778-6086-4660-95b8-2ed2d598f0e8}, 10.151.2.176: {79dcc778-6086-4660-95b8-2ed2d598f0e8}}} }
27042025-02-28T11:10:57.367ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27052025-02-28T11:10:57.368ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone file = illumos-utils/src/running_zone.rs:489 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27062025-02-28T11:10:57.557ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 38.484321ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27072025-02-28T11:10:57.607ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 56.538059ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27082025-02-28T11:10:57.680ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 280.231558ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27092025-02-28T11:10:57.969ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 561.911487ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27102025-02-28T11:10:58.542ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 701.627756ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27112025-02-28T11:10:58.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43939
27122025-02-28T11:10:59.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46328
27132025-02-28T11:10:59.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46328 req_id = 900145ea-27b1-4595-b475-504273707caf response_code = 200 uri = /v2p
27142025-02-28T11:10:59.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64113
27152025-02-28T11:10:59.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27162025-02-28T11:10:59.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27172025-02-28T11:10:59.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64113 req_id = 6c699f75-bbcd-41d9-a753-3e30ead36c87 response_code = 204 uri = /switch-ports
27182025-02-28T11:10:59.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64113 req_id = 52698ad5-bb79-4986-84c2-32484ad6650c response_code = 200 uri = /network-bootstore-config
27192025-02-28T11:10:59.255ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 887.646307ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27202025-02-28T11:11:00.156ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 1.331332653s file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27212025-02-28T11:11:00.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56340
27222025-02-28T11:11:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56340 req_id = 887b064b-6201-46e5-bd72-19556f81bd33 response_code = 200 uri = /vpc-routes
27232025-02-28T11:11:00.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57787
27242025-02-28T11:11:00.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {b1692cf8-ea8a-458d-b54c-9c1fe540a7ab: {10.151.2.176: {79dcc778-6086-4660-95b8-2ed2d598f0e8}, 10.151.2.175: {79dcc778-6086-4660-95b8-2ed2d598f0e8}}} }
27252025-02-28T11:11:00.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56340 req_id = 97c2c002-31ca-4fd5-aafb-f418f8098b1d response_code = 204 uri = /eip-gateways
27262025-02-28T11:11:00.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52133
27272025-02-28T11:11:00.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54046
27282025-02-28T11:11:00.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54046 req_id = 06fbca68-bc8a-4f21-9d7e-e7d010799e2d response_code = 200 uri = /v2p
27292025-02-28T11:11:00.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60959
27302025-02-28T11:11:00.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27312025-02-28T11:11:00.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27322025-02-28T11:11:00.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60959 req_id = ac87ad9b-f875-4915-aa4a-5f77596be8f3 response_code = 204 uri = /switch-ports
27332025-02-28T11:11:00.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38236
27342025-02-28T11:11:00.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60959 req_id = 02484d42-2c1c-4f40-9e43-5c3df8431e9d response_code = 200 uri = /network-bootstore-config
27352025-02-28T11:11:00.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 684 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56340 req_id = 0c132017-8fd4-4727-8a79-24d00d2b0d19 response_code = 204 uri = /vpc-routes
27362025-02-28T11:11:00.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38236 req_id = cfac57bc-644e-4ede-86d8-6e101449abf4 response_code = 200 uri = /vpc-routes
27372025-02-28T11:11:00.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {b1692cf8-ea8a-458d-b54c-9c1fe540a7ab: {10.151.2.175: {79dcc778-6086-4660-95b8-2ed2d598f0e8}, 10.151.2.176: {79dcc778-6086-4660-95b8-2ed2d598f0e8}}} }
27382025-02-28T11:11:00.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38236 req_id = 442bc238-4708-4578-b6e7-c5d693b560f9 response_code = 204 uri = /eip-gateways
27392025-02-28T11:11:00.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38236 req_id = 38184eb7-7ddb-4804-b3ae-0c353aff4462 response_code = 204 uri = /vpc-routes
27402025-02-28T11:11:00.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54215
27412025-02-28T11:11:00.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27422025-02-28T11:11:00.919ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27432025-02-28T11:11:00.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54215 req_id = 2d47607c-9a14-4653-a545-46ef10ad0607 response_code = 204 uri = /switch-ports
27442025-02-28T11:11:00.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54215 req_id = c27f16dc-3948-4ab0-9594-a29bb8afb37e response_code = 200 uri = /network-bootstore-config
27452025-02-28T11:11:01.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43291
27462025-02-28T11:11:01.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43291 req_id = 239174b6-6a2d-4a2c-bf23-b1f2be3fd402 response_code = 200 uri = /v2p
27472025-02-28T11:11:01.499ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 575.321675ms file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27482025-02-28T11:11:02.085ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87") failed: Property not found. retry in 1.344237114s file = illumos-utils/src/svc.rs:42 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 zone = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27492025-02-28T11:11:03.459ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87 file = sled-agent/src/instance.rs:2133 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27502025-02-28T11:11:03.469ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27512025-02-28T11:11:03.506ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27522025-02-28T11:11:03.591ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27532025-02-28T11:11:03.592ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-28T11:11:03.592815844Z } file = sled-agent/src/instance.rs:842 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27542025-02-28T11:11:03.593ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T11:11:03.592815844Z } propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27552025-02-28T11:11:03.593ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T11:11:03.592815844Z }, migration_in: None, migration_out: None }
27562025-02-28T11:11:03.613ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
27572025-02-28T11:11:03.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2957090 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52133 req_id = 3d113b30-c628-4a25-a295-262d9fa0f41b response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87/state
27582025-02-28T11:11:03.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7630744 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45154 req_id = 67e79b96-93c1-4ef2-876b-f3b936b278c4 response_code = 204 uri = /eip-gateways
27592025-02-28T11:11:03.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4785489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43939 req_id = 4b4467d8-753a-42f5-8333-03f8d70c62ee response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87/state
27602025-02-28T11:11:03.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3138805 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57787 req_id = 2a719773-0757-4b81-878b-f2307773a6d6 response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87/state
27612025-02-28T11:11:03.643ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-28T11:11:03.643007266Z } file = sled-agent/src/instance.rs:842 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27622025-02-28T11:11:03.643ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T11:11:03.643007266Z } propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27632025-02-28T11:11:03.643ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T11:11:03.643007266Z }, migration_in: None, migration_out: None }
27642025-02-28T11:11:03.710ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: ee6e957f-5eb3-4fa3-b084-98dbf5d9a002, version: 3 } old_vers = RouterVersion { router_id: ee6e957f-5eb3-4fa3-b084-98dbf5d9a002, version: 3 } subnet = RouterId { vni: Vni(15171437), kind: System }
27652025-02-28T11:11:03.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45154 req_id = de03d89c-752f-42e3-b0bf-84b264cdd914 response_code = 204 uri = /vpc-routes
27662025-02-28T11:11:03.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64604
27672025-02-28T11:11:03.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64604 req_id = b07ab479-c147-4147-b364-9a45672d2aea response_code = 200 uri = /vpc-routes
27682025-02-28T11:11:03.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {b1692cf8-ea8a-458d-b54c-9c1fe540a7ab: {10.151.2.175: {79dcc778-6086-4660-95b8-2ed2d598f0e8}, 10.151.2.176: {79dcc778-6086-4660-95b8-2ed2d598f0e8}}} }
27692025-02-28T11:11:03.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64604 req_id = c1d46f31-5560-45fc-b7b4-50154875231c response_code = 204 uri = /eip-gateways
27702025-02-28T11:11:03.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64604 req_id = 4df77913-2509-4da1-866e-fc640d24c32f response_code = 204 uri = /vpc-routes
27712025-02-28T11:11:10.798ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7761 local_addr = [fd00:1122:3344:101::1]:41403 method = GET remote_addr = [fd00:1122:3344:101::d]:54435 req_id = 5502ae92-db4e-4eca-b2b7-eb14a8882f03 response_code = 200 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f uri = /e34399da-90ab-4780-9b78-9879d23c2d5f
27722025-02-28T11:11:12.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52242
27732025-02-28T11:11:12.021ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52242 req_id = f202f265-e361-46bb-bca6-91394b9c8755 response_code = 200 uri = /baseboard
27742025-02-28T11:11:13.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35742
27752025-02-28T11:11:13.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35742 req_id = 30680cbf-67fd-4a45-9cb1-464727252b6a response_code = 200 uri = /vmms/15e1aea6-e0c0-4831-ac46-cdeb73873f87/state
27762025-02-28T11:11:13.333ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-28T11:11:13.333857825Z } file = sled-agent/src/instance.rs:842 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27772025-02-28T11:11:13.333ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T11:11:13.333857825Z } propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27782025-02-28T11:11:13.333ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T11:11:13.333857825Z }, migration_in: None, migration_out: None }
27792025-02-28T11:11:13.347ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-28T11:11:13.347878926Z } file = sled-agent/src/instance.rs:842 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27802025-02-28T11:11:13.347ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-28T11:11:13.347878926Z } propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27812025-02-28T11:11:13.347ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27822025-02-28T11:11:13.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27832025-02-28T11:11:13.348ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27842025-02-28T11:11:13.348ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/7aa7093c-069b-4cb1-ae18-35dd530e3c7e/debug/bundle/zone", "/pool/int/ff45b1a0-ec5b-4ba2-8d6b-48e4b1af1f49/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f7d5a9c4-cb15-48f9-b917-417a6c7f99dd/crypt/debug", "/pool/ext/198de296-2120-47e0-aaa7-ce837077a9bd/crypt/debug", "/pool/ext/36d3c3e4-af57-409f-868d-1af0fe9ba6b3/crypt/debug", "/pool/ext/3c8d4110-32ba-46e1-8821-6881348da454/crypt/debug", "/pool/ext/3a657f38-eded-4dc9-98a4-74fdac1ff02e/crypt/debug", "/pool/ext/cff584ba-ea1c-4f06-a4dc-f0d5b70d5cdf/crypt/debug", "/pool/ext/c223d649-aefc-4563-b832-624daf4863fe/crypt/debug", "/pool/ext/191404b5-bb5f-4942-aade-4f02119d69b0/crypt/debug", "/pool/ext/e2769f49-088a-46d9-97a0-ae743e3e4e75/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87
27852025-02-28T11:11:13.974ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87", bundle_id: e4c7f08f-5bb9-47c4-af9d-93bc810c4fac }, time_created: 2025-02-28T11:11:13.348746513Z, version: 0, cause: TerminatedInstance }
27862025-02-28T11:11:13.974ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_15e1aea6-e0c0-4831-ac46-cdeb73873f87 file = sled-agent/src/instance.rs:1376 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27872025-02-28T11:11:15.752ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27882025-02-28T11:11:15.769ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(15171437), kind: System }
27892025-02-28T11:11:15.769ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(15171437), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27902025-02-28T11:11:15.770ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:11:15.770111444Z }, migration_in: None, migration_out: None }
27912025-02-28T11:11:15.793ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:11:15.770111444Z }, migration_in: None, migration_out: None }
27922025-02-28T11:11:15.797ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 7c8e94fb-4077-4547-92cb-05e8f0c2107a propolis_id = 15e1aea6-e0c0-4831-ac46-cdeb73873f87
27932025-02-28T11:11:16.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57455
27942025-02-28T11:11:16.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57455 req_id = 97e1601f-a3fa-418a-b2e8-3badaa8a4d5c response_code = 200 uri = /vpc-routes
27952025-02-28T11:11:16.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
27962025-02-28T11:11:16.279ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f
27972025-02-28T11:11:16.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57455 req_id = c45c9e52-30e6-43db-8e38-965529b1764a response_code = 204 uri = /eip-gateways
27982025-02-28T11:11:16.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57455 req_id = 1edcef97-9783-448a-9cf3-2ea50005a378 response_code = 204 uri = /vpc-routes
27992025-02-28T11:11:16.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55711
28002025-02-28T11:11:16.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55711 req_id = 1fb2bc8e-19a8-494c-b880-1d8292ef1f77 response_code = 200 uri = /v2p
28012025-02-28T11:11:16.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63305
28022025-02-28T11:11:16.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63305 req_id = c92904f4-bc0a-4410-832e-fb9793a40c9b response_code = 200 uri = /v2p
28032025-02-28T11:11:16.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61650
28042025-02-28T11:11:16.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61650 req_id = e0c4f958-031d-456f-8d14-d77467fbd381 response_code = 200 uri = /vpc-routes
28052025-02-28T11:11:16.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
28062025-02-28T11:11:16.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61650 req_id = 8359e769-ca15-4536-9654-99c8633e3055 response_code = 204 uri = /eip-gateways
28072025-02-28T11:11:16.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61650 req_id = 917ce97e-c114-4667-a44f-2a4c52ba9621 response_code = 204 uri = /vpc-routes
28082025-02-28T11:11:17.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61067
28092025-02-28T11:11:17.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61067 req_id = 37fffe64-ab21-45e0-940c-12996489e841 response_code = 200 uri = /vpc-routes
28102025-02-28T11:11:17.579ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = e34399da-90ab-4780-9b78-9879d23c2d5f values = ExternalIpGatewayMap { mappings: {} }
28112025-02-28T11:11:17.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61067 req_id = 11a1dabc-5519-4426-bf9e-55f8eff48628 response_code = 204 uri = /eip-gateways
28122025-02-28T11:11:17.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61067 req_id = bceb65aa-23fb-4c62-80af-786a122a3dc9 response_code = 204 uri = /vpc-routes