Max level shown:
1 [ Feb 28 23:06:59 Enabled. ]
2 [ Feb 28 23:06:59 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 28 23:06:59 Method "start" exited with status 0. ]
4 [ Feb 28 23:06:59 Rereading configuration. ]
5 [ Feb 28 23:06:59 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-28T23:06:59.095ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-28T23:06:59.095ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-02-28T23:06:59.149ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-02-28T23:06:59.149ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-28T23:06:59.264ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-28T23:06:59.272ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-28T23:06:59.280ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-02-28T23:06:59.886ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-02-28T23:07:00.026ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-28T23:07:00.026ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-28T23:07:00.026ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-28T23:07:00.026ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-28T23:07:00.026ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-02-28T23:07:00.026ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-02-28T23:07:00.029ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-28T23:07:00.029ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-28T23:07:00.029ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-28T23:07:00.029ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-28T23:07:00.029ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-28T23:07:00.029ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-28T23:07:00.029ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-28T23:07:00.029ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-28T23:07:00.029ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-28T23:07:00.041ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-28T23:07:00.041ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool)
322025-02-28T23:07:00.139ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal }
332025-02-28T23:07:00.504ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-28T23:07:00.504ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-28T23:07:00.504ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-28T23:07:00.504ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-28T23:07:00.504ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-28T23:07:00.504ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-28T23:07:00.504ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-28T23:07:00.513ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-28T23:07:00.513ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool)
422025-02-28T23:07:00.601ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal }
432025-02-28T23:07:00.964ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-28T23:07:00.964ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-28T23:07:00.964ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-28T23:07:00.964ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-02-28T23:07:00.964ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482025-02-28T23:07:00.964ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492025-02-28T23:07:00.964ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-28T23:07:00.964ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-02-28T23:07:00.964ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-02-28T23:07:00.964ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-02-28T23:07:00.964ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-02-28T23:07:00.964ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
902025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-02-28T23:07:00.965ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-02-28T23:07:00.965ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-02-28T23:07:00.965ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-28T23:07:00.965ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-28T23:07:00.965ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-02-28T23:07:00.965ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-02-28T23:07:00.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-02-28T23:07:00.965ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-02-28T23:07:00.965ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-02-28T23:07:00.965ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-28T23:07:00.965ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-28T23:07:00.976ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-28T23:07:00.976ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1478, tv_nsec: 840845378 } time_to_next_cleanup = 599.999926178s
1142025-02-28T23:07:00.977ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1152025-02-28T23:07:00.977ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-02-28T23:07:00.979ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-28T23:07:00.979ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-28T23:07:00.980ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-02-28T23:07:00.981ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-02-28T23:07:00.982ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-28T23:07:00.982ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-28T23:07:00.982ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-28T23:07:00.982ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-28T23:07:00.982ZINFOSledAgent (RSS): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-28T23:07:00.982ZINFOSledAgent (RSS): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-28T23:07:00.982ZINFOSledAgent (RSS): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-28T23:07:00.982ZINFOSledAgent (RSS): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-28T23:07:00.982ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-28T23:07:00.982ZINFOSledAgent (RSS): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-28T23:07:00.982ZINFOSledAgent (RSS): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-28T23:07:00.983ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-28T23:07:00.983ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-28T23:07:00.983ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-28T23:07:00.983ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-28T23:07:00.983ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-02-28T23:07:00.983ZINFOSledAgent (bootstore): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-02-28T23:07:00.983ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-02-28T23:07:00.983ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-02-28T23:07:00.983ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: eb977560-79bb-4094-9f3c-0c8f67caef5b (sled), rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-02-28T23:07:00.984ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-02-28T23:07:00.984ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-02-28T23:07:00.988ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-02-28T23:07:00.994ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-02-28T23:07:00.995ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-02-28T23:07:00.999ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-02-28T23:07:00.999ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-02-28T23:07:00.999ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52235
1482025-02-28T23:07:00.999ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: eb977560-79bb-4094-9f3c-0c8f67caef5b (sled), rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-02-28T23:07:00.999ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-02-28T23:07:01.000ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-02-28T23:07:01.000ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-02-28T23:07:01.000ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1542025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1552025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-02-28T23:07:01.000ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-02-28T23:07:01.000ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-02-28T23:07:01.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-28T23:07:01.039ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-28T23:07:01.056ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-28T23:07:01.064ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1662025-02-28T23:07:01.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-28T23:07:01.064ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1682025-02-28T23:07:01.064ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1692025-02-28T23:07:01.068ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4152b9f1-176b-4200-9fde-80363543d52b", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4152b9f1-176b-4200-9fde-80363543d52b" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 59.509083ms
1702025-02-28T23:07:01.078ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_566d44c0-a314-4b53-9402-fb067e4e8db8/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-28T23:07:01.101ZINFOSledAgent: successfully created encrypted zvol: name="oxi_566d44c0-a314-4b53-9402-fb067e4e8db8/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-28T23:07:01.101ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_566d44c0-a314-4b53-9402-fb067e4e8db8/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-28T23:07:01.106ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1742025-02-28T23:07:01.106ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-28T23:07:01.106ZINFOSledAgent (BackingFs): Ensuring dataset oxi_566d44c0-a314-4b53-9402-fb067e4e8db8/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-28T23:07:01.129ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1772025-02-28T23:07:01.129ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0391bed4-0d23-4d9e-9f05-81b6824eac44", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0391bed4-0d23-4d9e-9f05-81b6824eac44" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 80.21386ms
1782025-02-28T23:07:01.175ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-02-28T23:07:01.210ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1802025-02-28T23:07:01.211ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9bfebece-9d4b-4a6b-8a2a-7711f76dae47", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9bfebece-9d4b-4a6b-8a2a-7711f76dae47" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 73.157708ms
1812025-02-28T23:07:01.285ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1822025-02-28T23:07:01.285ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a48d76ea-39d7-48ec-8af9-dfd5abf7ee91", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a48d76ea-39d7-48ec-8af9-dfd5abf7ee91" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 124.967289ms
1832025-02-28T23:07:01.394ZINFOSledAgent (BackingFs): Mounting oxi_566d44c0-a314-4b53-9402-fb067e4e8db8/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-02-28T23:07:01.407ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-02-28T23:07:01.407ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-02-28T23:07:01.407ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-02-28T23:07:01.407ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-02-28T23:07:01.411ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1892025-02-28T23:07:01.412ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9e4fe325-d6be-4b47-8f79-f7aafd5cc260", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9e4fe325-d6be-4b47-8f79-f7aafd5cc260" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 198.352856ms
1902025-02-28T23:07:01.611ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1912025-02-28T23:07:01.612ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1874b60b-082d-402e-8781-061894c96ede", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1874b60b-082d-402e-8781-061894c96ede" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 200.442965ms
1922025-02-28T23:07:01.813ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1932025-02-28T23:07:01.814ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fec559c6-4e21-4a3f-a400-58a5aaafb55e", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fec559c6-4e21-4a3f-a400-58a5aaafb55e" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 290.169862ms
1942025-02-28T23:07:02.105ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
1952025-02-28T23:07:02.106ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0c34c240-b3f3-4cea-a725-611b2923f7f2", "content-length": "124", "date": "Fri, 28 Feb 2025 23:07:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0c34c240-b3f3-4cea-a725-611b2923f7f2" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 244.760504ms
1962025-02-28T23:07:02.157ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1972025-02-28T23:07:02.162ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:54102 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1982025-02-28T23:07:02.163ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
1992025-02-28T23:07:02.163ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:54102 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = eb977560-79bb-4094-9f3c-0c8f67caef5b sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2002025-02-28T23:07:02.163ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 160.237135ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2012025-02-28T23:07:02.165ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2022025-02-28T23:07:02.165ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2032025-02-28T23:07:02.165ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2042025-02-28T23:07:02.165ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052025-02-28T23:07:02.325ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 482.603252ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2062025-02-28T23:07:02.352ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b4848917-f3dd-4b83-ac2a-514cdf0c5803, sled_id: eb977560-79bb-4094-9f3c-0c8f67caef5b }
2072025-02-28T23:07:02.810ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.05722441s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2082025-02-28T23:07:03.869ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.229922184s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2092025-02-28T23:07:05.101ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.810555158s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2102025-02-28T23:07:05.268ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2112025-02-28T23:07:05.268ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2122025-02-28T23:07:05.268ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2132025-02-28T23:07:05.268ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2142025-02-28T23:07:05.269ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2152025-02-28T23:07:05.269ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2162025-02-28T23:07:05.270ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2172025-02-28T23:07:05.272ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2182025-02-28T23:07:05.272ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f8925048-2af8-4146-a850-ccf62354fcde'/> <propval type="astring" name="rack_id" value='b4848917-f3dd-4b83-ac2a-514cdf0c5803'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe45:55f2'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b4848917-f3dd-4b83-ac2a-514cdf0c5803'/> <propval type="astring" name="sled_id" value='eb977560-79bb-4094-9f3c-0c8f67caef5b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='b4848917-f3dd-4b83-ac2a-514cdf0c5803'/> <propval type="astring" name="sled_id" value='eb977560-79bb-4094-9f3c-0c8f67caef5b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='eb977560-79bb-4094-9f3c-0c8f67caef5b'/> <propval type="astring" name="rack_uuid" value='b4848917-f3dd-4b83-ac2a-514cdf0c5803'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='eb977560-79bb-4094-9f3c-0c8f67caef5b'/> <propval type="astring" name="rack_uuid" value='b4848917-f3dd-4b83-ac2a-514cdf0c5803'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2192025-02-28T23:07:05.272ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2202025-02-28T23:07:05.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 62.106349ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-28T23:07:05.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 88.155138ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-02-28T23:07:06.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 248.704871ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-02-28T23:07:06.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 332.610907ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-28T23:07:06.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 798.220945ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-02-28T23:07:07.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.259173022s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-02-28T23:07:09.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.312324783s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2272025-02-28T23:07:10.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 516.251263ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2282025-02-28T23:07:10.913ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.071768156s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2292025-02-28T23:07:11.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-02-28T23:07:11.512ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2312025-02-28T23:07:11.513ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2322025-02-28T23:07:11.513ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2332025-02-28T23:07:11.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2342025-02-28T23:07:11.514ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-02-28T23:07:11.514ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362025-02-28T23:07:11.514ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372025-02-28T23:07:11.514ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382025-02-28T23:07:11.514ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2392025-02-28T23:07:11.514ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52235
2402025-02-28T23:07:11.723ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2412025-02-28T23:07:11.723ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2422025-02-28T23:07:11.728ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-02-28T23:07:11.728ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2442025-02-28T23:07:11.728ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2452025-02-28T23:07:11.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63312
2462025-02-28T23:07:11.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-02-28T23:07:11.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-02-28T23:07:11.961ZINFOSledAgent (ServiceManager): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-02-28T23:07:11.961ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-02-28T23:07:11.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63312 req_id = 7a4d703a-1ecd-48cc-85d7-51d543ddb593 response_code = 200 uri = /inventory
2512025-02-28T23:07:11.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33189
2522025-02-28T23:07:11.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33189 req_id = cb604b2d-f154-49c0-b5bc-410bfd9e3eb3 response_code = 200 uri = /sled-role
2532025-02-28T23:07:12.030ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 0b0ec2db-66c8-4d70-96e6-70f3c574f28c (physical_disk), pool_id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 605d2b4b-7f92-4486-8a73-0d6963744219 (physical_disk), pool_id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 74adabc7-72ce-4a21-b237-fb117e0d289a (physical_disk), pool_id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7e9043b5-95e2-458d-b0ac-8e24db755c30 (physical_disk), pool_id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 832847ba-02a5-4131-822f-cd66ef45e732 (physical_disk), pool_id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a91ae58c-bdc6-491e-be64-fe3ef955570b (physical_disk), pool_id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c0c62de5-be95-4a8f-b959-677b98c070d9 (physical_disk), pool_id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: dd028f25-691c-4eec-8576-08a03981e453 (physical_disk), pool_id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: e13b3c2b-1c81-4e48-b7b5-dae9e863033e (physical_disk), pool_id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2542025-02-28T23:07:12.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41369
2552025-02-28T23:07:12.031ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2562025-02-28T23:07:12.031ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 0b0ec2db-66c8-4d70-96e6-70f3c574f28c (physical_disk), pool_id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 605d2b4b-7f92-4486-8a73-0d6963744219 (physical_disk), pool_id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 74adabc7-72ce-4a21-b237-fb117e0d289a (physical_disk), pool_id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7e9043b5-95e2-458d-b0ac-8e24db755c30 (physical_disk), pool_id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 832847ba-02a5-4131-822f-cd66ef45e732 (physical_disk), pool_id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a91ae58c-bdc6-491e-be64-fe3ef955570b (physical_disk), pool_id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c0c62de5-be95-4a8f-b959-677b98c070d9 (physical_disk), pool_id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: dd028f25-691c-4eec-8576-08a03981e453 (physical_disk), pool_id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: e13b3c2b-1c81-4e48-b7b5-dae9e863033e (physical_disk), pool_id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2572025-02-28T23:07:12.031ZINFOSledAgent (StorageManager): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-02-28T23:07:12.031ZINFOSledAgent (StorageManager): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-02-28T23:07:12.031ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2602025-02-28T23:07:12.031ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2612025-02-28T23:07:12.031ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2622025-02-28T23:07:12.031ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2632025-02-28T23:07:12.031ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2642025-02-28T23:07:12.167ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2669570204347805593 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2652025-02-28T23:07:12.167ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 875424460270775760 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2662025-02-28T23:07:12.170ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2672025-02-28T23:07:12.170ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e6859987-fd24-4257-800d-91c0f9f61334 (zpool)
2682025-02-28T23:07:12.607ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2692025-02-28T23:07:12.609ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
2702025-02-28T23:07:12.666ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }
2712025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-02-28T23:07:12.674ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782025-02-28T23:07:12.711ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-02-28T23:07:12.719ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone file = sled-storage/src/dataset.rs:302
2802025-02-28T23:07:12.856ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e6859987-fd24-4257-800d-91c0f9f61334 file = sled-storage/src/dataset.rs:388
2812025-02-28T23:07:12.864ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822025-02-28T23:07:12.864ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832025-02-28T23:07:12.864ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842025-02-28T23:07:12.864ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852025-02-28T23:07:12.864ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862025-02-28T23:07:12.874ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872025-02-28T23:07:12.874ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool)
2882025-02-28T23:07:12.970ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }
2892025-02-28T23:07:12.978ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902025-02-28T23:07:12.978ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912025-02-28T23:07:12.978ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922025-02-28T23:07:12.978ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932025-02-28T23:07:12.978ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-02-28T23:07:12.979ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-02-28T23:07:12.979ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962025-02-28T23:07:13.013ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972025-02-28T23:07:13.021ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/zone file = sled-storage/src/dataset.rs:302
2982025-02-28T23:07:13.160ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402 file = sled-storage/src/dataset.rs:388
2992025-02-28T23:07:13.168ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002025-02-28T23:07:13.168ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012025-02-28T23:07:13.168ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022025-02-28T23:07:13.168ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032025-02-28T23:07:13.168ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042025-02-28T23:07:13.178ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052025-02-28T23:07:13.178ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool)
3062025-02-28T23:07:13.266ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }
3072025-02-28T23:07:13.272ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082025-02-28T23:07:13.272ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092025-02-28T23:07:13.272ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102025-02-28T23:07:13.273ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112025-02-28T23:07:13.273ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-02-28T23:07:13.273ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-02-28T23:07:13.273ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142025-02-28T23:07:13.306ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152025-02-28T23:07:13.313ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone file = sled-storage/src/dataset.rs:302
3162025-02-28T23:07:13.452ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e file = sled-storage/src/dataset.rs:388
3172025-02-28T23:07:13.460ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182025-02-28T23:07:13.460ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192025-02-28T23:07:13.460ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202025-02-28T23:07:13.460ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212025-02-28T23:07:13.460ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222025-02-28T23:07:13.470ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232025-02-28T23:07:13.470ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool)
3242025-02-28T23:07:13.567ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }
3252025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3262025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3272025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3282025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3292025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-02-28T23:07:13.575ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3322025-02-28T23:07:13.610ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332025-02-28T23:07:13.613ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
3342025-02-28T23:07:13.618ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone file = sled-storage/src/dataset.rs:302
3352025-02-28T23:07:13.757ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3 file = sled-storage/src/dataset.rs:388
3362025-02-28T23:07:13.765ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372025-02-28T23:07:13.765ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382025-02-28T23:07:13.765ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392025-02-28T23:07:13.765ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402025-02-28T23:07:13.765ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412025-02-28T23:07:13.774ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422025-02-28T23:07:13.774ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool)
3432025-02-28T23:07:13.867ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }
3442025-02-28T23:07:13.874ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-02-28T23:07:13.875ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512025-02-28T23:07:13.909ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522025-02-28T23:07:13.917ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone file = sled-storage/src/dataset.rs:302
3532025-02-28T23:07:14.054ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f file = sled-storage/src/dataset.rs:388
3542025-02-28T23:07:14.063ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552025-02-28T23:07:14.063ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562025-02-28T23:07:14.063ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572025-02-28T23:07:14.063ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582025-02-28T23:07:14.063ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592025-02-28T23:07:14.073ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602025-02-28T23:07:14.073ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool)
3612025-02-28T23:07:14.165ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }
3622025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-02-28T23:07:14.172ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692025-02-28T23:07:14.210ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702025-02-28T23:07:14.217ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone file = sled-storage/src/dataset.rs:302
3712025-02-28T23:07:14.347ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_17d61349-66a6-4ab5-a1a2-619a947659ed file = sled-storage/src/dataset.rs:388
3722025-02-28T23:07:14.354ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3732025-02-28T23:07:14.354ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3742025-02-28T23:07:14.354ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3752025-02-28T23:07:14.354ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762025-02-28T23:07:14.354ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772025-02-28T23:07:14.363ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3782025-02-28T23:07:14.363ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool)
3792025-02-28T23:07:14.456ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }
3802025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3812025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3822025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3832025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3842025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862025-02-28T23:07:14.463ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3872025-02-28T23:07:14.499ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882025-02-28T23:07:14.506ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone file = sled-storage/src/dataset.rs:302
3892025-02-28T23:07:14.616ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
3902025-02-28T23:07:14.635ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 file = sled-storage/src/dataset.rs:388
3912025-02-28T23:07:14.642ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922025-02-28T23:07:14.642ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932025-02-28T23:07:14.642ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942025-02-28T23:07:14.642ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952025-02-28T23:07:14.642ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962025-02-28T23:07:14.651ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972025-02-28T23:07:14.651ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9395a765-3cd5-4500-919f-891f129f4358 (zpool)
3982025-02-28T23:07:14.738ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }
3992025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-02-28T23:07:14.745ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062025-02-28T23:07:14.779ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072025-02-28T23:07:14.785ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/zone file = sled-storage/src/dataset.rs:302
4082025-02-28T23:07:14.923ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9395a765-3cd5-4500-919f-891f129f4358 file = sled-storage/src/dataset.rs:388
4092025-02-28T23:07:14.931ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102025-02-28T23:07:14.931ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112025-02-28T23:07:14.931ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122025-02-28T23:07:14.931ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132025-02-28T23:07:14.931ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142025-02-28T23:07:14.942ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152025-02-28T23:07:14.942ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d5534d82-e391-4535-be4a-591aedf1d99f (zpool)
4162025-02-28T23:07:15.038ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }
4172025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4182025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4192025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4202025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4212025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-02-28T23:07:15.045ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4242025-02-28T23:07:15.100ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252025-02-28T23:07:15.109ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone file = sled-storage/src/dataset.rs:302
4262025-02-28T23:07:15.248ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d5534d82-e391-4535-be4a-591aedf1d99f file = sled-storage/src/dataset.rs:388
4272025-02-28T23:07:15.256ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4282025-02-28T23:07:15.256ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4292025-02-28T23:07:15.257ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302025-02-28T23:07:15.257ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 566d44c0-a314-4b53-9402-fb067e4e8db8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a587e7a0-bc40-4e66-bda3-e4649e82a46e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4312025-02-28T23:07:15.257ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4322025-02-28T23:07:15.257ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4332025-02-28T23:07:15.257ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4352025-02-28T23:07:15.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4362025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4372025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4382025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4392025-02-28T23:07:15.257ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4402025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4412025-02-28T23:07:15.257ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4422025-02-28T23:07:15.257ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4432025-02-28T23:07:15.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3226946 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41369 req_id = df0d8294-a84a-4b05-8c3f-51e97f058659 response_code = 200 uri = /omicron-physical-disks
4442025-02-28T23:07:15.289ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0091e484-882b-430f-a5e3-2aca60bfc1af (dataset): DatasetConfig { id: 0091e484-882b-430f-a5e3-2aca60bfc1af (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 035ac2af-8923-4586-a47e-102e53f2f1f6 (dataset): DatasetConfig { id: 035ac2af-8923-4586-a47e-102e53f2f1f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0421fa9e-933c-4900-b305-447c2132d1b3 (dataset): DatasetConfig { id: 0421fa9e-933c-4900-b305-447c2132d1b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 076a2a88-f1b8-4212-868d-a31cc16b7d61 (dataset): DatasetConfig { id: 076a2a88-f1b8-4212-868d-a31cc16b7d61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0b145d2f-2725-4ce2-af66-5e51b6d8df6f (dataset): DatasetConfig { id: 0b145d2f-2725-4ce2-af66-5e51b6d8df6f (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d9168f8-c9ab-46a0-b133-cd445ed5426d (dataset): DatasetConfig { id: 0d9168f8-c9ab-46a0-b133-cd445ed5426d (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ee1543f-e71b-4f61-9ce0-cf2287420b7e (dataset): DatasetConfig { id: 0ee1543f-e71b-4f61-9ce0-cf2287420b7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11a5a02d-920d-4fbe-b1dc-23ae1ea422dc (dataset): DatasetConfig { id: 11a5a02d-920d-4fbe-b1dc-23ae1ea422dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e7edea-8a8d-4629-a36a-bebe12126357 (dataset): DatasetConfig { id: 12e7edea-8a8d-4629-a36a-bebe12126357 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1304568a-6c22-4e21-b542-bf7b49fffcdb (dataset): DatasetConfig { id: 1304568a-6c22-4e21-b542-bf7b49fffcdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136ff21a-4441-432e-95e2-4604002a3df7 (dataset): DatasetConfig { id: 136ff21a-4441-432e-95e2-4604002a3df7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1872e6aa-21c1-45e8-875d-5c7de2ab152f (dataset): DatasetConfig { id: 1872e6aa-21c1-45e8-875d-5c7de2ab152f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd5db1c-64ac-46ad-ad6b-b7201269faac (dataset): DatasetConfig { id: 1dd5db1c-64ac-46ad-ad6b-b7201269faac (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1eee8daa-767d-4d29-9b71-b2bfc842a296 (dataset): DatasetConfig { id: 1eee8daa-767d-4d29-9b71-b2bfc842a296 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2934ebbd-e7f6-4c49-897c-a6aeadafd202 (dataset): DatasetConfig { id: 2934ebbd-e7f6-4c49-897c-a6aeadafd202 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 295e1278-67ca-43b3-a83e-db220d42d750 (dataset): DatasetConfig { id: 295e1278-67ca-43b3-a83e-db220d42d750 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c6948f7-ed67-4d2c-9608-82e98c2a765e (dataset): DatasetConfig { id: 2c6948f7-ed67-4d2c-9608-82e98c2a765e (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c7b22f2-f59c-4f2f-8a63-09e4be2f0940 (dataset): DatasetConfig { id: 2c7b22f2-f59c-4f2f-8a63-09e4be2f0940 (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e668af9-05e3-451b-9854-6a207afe5e3d (dataset): DatasetConfig { id: 2e668af9-05e3-451b-9854-6a207afe5e3d (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 367b3548-a3f2-489a-83d3-74b47c6315bc (dataset): DatasetConfig { id: 367b3548-a3f2-489a-83d3-74b47c6315bc (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 370731fc-044a-46a5-a119-8d3c331e81ae (dataset): DatasetConfig { id: 370731fc-044a-46a5-a119-8d3c331e81ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a7fb8ea-f5cf-4c77-8d92-6295bb21aba5 (dataset): DatasetConfig { id: 3a7fb8ea-f5cf-4c77-8d92-6295bb21aba5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 417f40ee-ae59-40b1-9089-256bc4b7d466 (dataset): DatasetConfig { id: 417f40ee-ae59-40b1-9089-256bc4b7d466 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44a7b184-deee-4dcc-8106-4b70db8201a1 (dataset): DatasetConfig { id: 44a7b184-deee-4dcc-8106-4b70db8201a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45ca6340-67bc-4567-8501-20dd35f4544e (dataset): DatasetConfig { id: 45ca6340-67bc-4567-8501-20dd35f4544e (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4630ee68-18b6-4006-82c9-639961745943 (dataset): DatasetConfig { id: 4630ee68-18b6-4006-82c9-639961745943 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e4b3bb-bfb4-49b8-8ed0-f911228251cc (dataset): DatasetConfig { id: 48e4b3bb-bfb4-49b8-8ed0-f911228251cc (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51c597d8-be33-42e4-b9b5-0cf277591b93 (dataset): DatasetConfig { id: 51c597d8-be33-42e4-b9b5-0cf277591b93 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 531678a6-0720-4980-af64-757d9b13167f (dataset): DatasetConfig { id: 531678a6-0720-4980-af64-757d9b13167f (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56a490fb-da2f-47da-9e7b-48e4c8c72e8e (dataset): DatasetConfig { id: 56a490fb-da2f-47da-9e7b-48e4c8c72e8e (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5ab496e1-ed2d-44b9-9a66-564e89e0823f (dataset): DatasetConfig { id: 5ab496e1-ed2d-44b9-9a66-564e89e0823f (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 633486ed-b832-478a-9533-d905d38ae99e (dataset): DatasetConfig { id: 633486ed-b832-478a-9533-d905d38ae99e (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6674e850-1f7d-453f-a8f5-6789ea6f9d74 (dataset): DatasetConfig { id: 6674e850-1f7d-453f-a8f5-6789ea6f9d74 (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7642f861-3481-4c7d-8df6-9db776c9a958 (dataset): DatasetConfig { id: 7642f861-3481-4c7d-8df6-9db776c9a958 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bbaa160-1d8b-47ea-b67a-38864c804bbc (dataset): DatasetConfig { id: 7bbaa160-1d8b-47ea-b67a-38864c804bbc (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c46b97c-df9a-4f87-955f-8a02fda61406 (dataset): DatasetConfig { id: 7c46b97c-df9a-4f87-955f-8a02fda61406 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 813414f0-67de-4204-b086-a03286137410 (dataset): DatasetConfig { id: 813414f0-67de-4204-b086-a03286137410 (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 835cb62d-334d-4b50-8ba8-21016564f5e7 (dataset): DatasetConfig { id: 835cb62d-334d-4b50-8ba8-21016564f5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86871c73-c749-4c85-aea1-c0be2e33dce5 (dataset): DatasetConfig { id: 86871c73-c749-4c85-aea1-c0be2e33dce5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b4a859-a7c2-4595-a992-7bcccf1c64bb (dataset): DatasetConfig { id: 86b4a859-a7c2-4595-a992-7bcccf1c64bb (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cbddc04-a6b3-4c3d-916d-41e0461b7932 (dataset): DatasetConfig { id: 8cbddc04-a6b3-4c3d-916d-41e0461b7932 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cdcc697-776b-4a9c-80c3-95719a4069c6 (dataset): DatasetConfig { id: 8cdcc697-776b-4a9c-80c3-95719a4069c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f3a7508-616e-4a82-a0c4-91b8327c2d1f (dataset): DatasetConfig { id: 9f3a7508-616e-4a82-a0c4-91b8327c2d1f (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a26a53e3-8c67-494c-aec7-7ef15e787429 (dataset): DatasetConfig { id: a26a53e3-8c67-494c-aec7-7ef15e787429 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acaee6e8-3809-4de5-b358-b0009a090394 (dataset): DatasetConfig { id: acaee6e8-3809-4de5-b358-b0009a090394 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adb94b14-804e-4f5e-b60b-633444e01083 (dataset): DatasetConfig { id: adb94b14-804e-4f5e-b60b-633444e01083 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8c0e7d7-1621-40aa-be18-0bd9373748de (dataset): DatasetConfig { id: b8c0e7d7-1621-40aa-be18-0bd9373748de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c590f269-7db6-4ae6-8a3a-da37d889c143 (dataset): DatasetConfig { id: c590f269-7db6-4ae6-8a3a-da37d889c143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c94c7c43-46cb-4389-b194-62279aeb8453 (dataset): DatasetConfig { id: c94c7c43-46cb-4389-b194-62279aeb8453 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb822d3b-3b4e-4cf0-8a34-7c347399ee61 (dataset): DatasetConfig { id: cb822d3b-3b4e-4cf0-8a34-7c347399ee61 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5aa83ed-2a66-4f55-8200-220395d9173a (dataset): DatasetConfig { id: d5aa83ed-2a66-4f55-8200-220395d9173a (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d65a3c9e-f790-42a8-93ea-d64c0876c5f3 (dataset): DatasetConfig { id: d65a3c9e-f790-42a8-93ea-d64c0876c5f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da81992a-5fec-452f-a6fd-6155e7ed8adb (dataset): DatasetConfig { id: da81992a-5fec-452f-a6fd-6155e7ed8adb (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc897171-3927-4a73-98a5-5a4cfb7124de (dataset): DatasetConfig { id: dc897171-3927-4a73-98a5-5a4cfb7124de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb11571-0ff0-4a6c-85fe-7e5d78eadc7d (dataset): DatasetConfig { id: ddb11571-0ff0-4a6c-85fe-7e5d78eadc7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7bcc4c5-0081-4e8b-9882-e53e392f4296 (dataset): DatasetConfig { id: e7bcc4c5-0081-4e8b-9882-e53e392f4296 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ee0ac3-0a9f-454a-9985-05b81cfd552f (dataset): DatasetConfig { id: e7ee0ac3-0a9f-454a-9985-05b81cfd552f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e95dce2b-42b1-4dc5-b036-eccc577809f3 (dataset): DatasetConfig { id: e95dce2b-42b1-4dc5-b036-eccc577809f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e988c7a0-27bb-467c-aeec-fa095b4e1dce (dataset): DatasetConfig { id: e988c7a0-27bb-467c-aeec-fa095b4e1dce (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eee7b643-07ad-4945-85d8-14b9f6473feb (dataset): DatasetConfig { id: eee7b643-07ad-4945-85d8-14b9f6473feb (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efea2144-d845-44a9-bfce-615a424c49d0 (dataset): DatasetConfig { id: efea2144-d845-44a9-bfce-615a424c49d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f00acc27-f9d6-4715-80ba-fc34665b57da (dataset): DatasetConfig { id: f00acc27-f9d6-4715-80ba-fc34665b57da (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f118326a-c9e7-4226-af6a-7227ecb9c26c (dataset): DatasetConfig { id: f118326a-c9e7-4226-af6a-7227ecb9c26c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f1bae58e-9a21-4ec2-a495-e68bbcc67d78 (dataset): DatasetConfig { id: f1bae58e-9a21-4ec2-a495-e68bbcc67d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f9a09e03-2ed8-436a-aba8-49b18404638e (dataset): DatasetConfig { id: f9a09e03-2ed8-436a-aba8-49b18404638e (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff9d584a-6c00-463b-9adc-4b999479eb84 (dataset): DatasetConfig { id: ff9d584a-6c00-463b-9adc-4b999479eb84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4452025-02-28T23:07:15.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56334
4462025-02-28T23:07:15.290ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4472025-02-28T23:07:15.290ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0091e484-882b-430f-a5e3-2aca60bfc1af (dataset): DatasetConfig { id: 0091e484-882b-430f-a5e3-2aca60bfc1af (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 035ac2af-8923-4586-a47e-102e53f2f1f6 (dataset): DatasetConfig { id: 035ac2af-8923-4586-a47e-102e53f2f1f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0421fa9e-933c-4900-b305-447c2132d1b3 (dataset): DatasetConfig { id: 0421fa9e-933c-4900-b305-447c2132d1b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 076a2a88-f1b8-4212-868d-a31cc16b7d61 (dataset): DatasetConfig { id: 076a2a88-f1b8-4212-868d-a31cc16b7d61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0b145d2f-2725-4ce2-af66-5e51b6d8df6f (dataset): DatasetConfig { id: 0b145d2f-2725-4ce2-af66-5e51b6d8df6f (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d9168f8-c9ab-46a0-b133-cd445ed5426d (dataset): DatasetConfig { id: 0d9168f8-c9ab-46a0-b133-cd445ed5426d (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ee1543f-e71b-4f61-9ce0-cf2287420b7e (dataset): DatasetConfig { id: 0ee1543f-e71b-4f61-9ce0-cf2287420b7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11a5a02d-920d-4fbe-b1dc-23ae1ea422dc (dataset): DatasetConfig { id: 11a5a02d-920d-4fbe-b1dc-23ae1ea422dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e7edea-8a8d-4629-a36a-bebe12126357 (dataset): DatasetConfig { id: 12e7edea-8a8d-4629-a36a-bebe12126357 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1304568a-6c22-4e21-b542-bf7b49fffcdb (dataset): DatasetConfig { id: 1304568a-6c22-4e21-b542-bf7b49fffcdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 136ff21a-4441-432e-95e2-4604002a3df7 (dataset): DatasetConfig { id: 136ff21a-4441-432e-95e2-4604002a3df7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1872e6aa-21c1-45e8-875d-5c7de2ab152f (dataset): DatasetConfig { id: 1872e6aa-21c1-45e8-875d-5c7de2ab152f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd5db1c-64ac-46ad-ad6b-b7201269faac (dataset): DatasetConfig { id: 1dd5db1c-64ac-46ad-ad6b-b7201269faac (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1eee8daa-767d-4d29-9b71-b2bfc842a296 (dataset): DatasetConfig { id: 1eee8daa-767d-4d29-9b71-b2bfc842a296 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2934ebbd-e7f6-4c49-897c-a6aeadafd202 (dataset): DatasetConfig { id: 2934ebbd-e7f6-4c49-897c-a6aeadafd202 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 295e1278-67ca-43b3-a83e-db220d42d750 (dataset): DatasetConfig { id: 295e1278-67ca-43b3-a83e-db220d42d750 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c6948f7-ed67-4d2c-9608-82e98c2a765e (dataset): DatasetConfig { id: 2c6948f7-ed67-4d2c-9608-82e98c2a765e (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c7b22f2-f59c-4f2f-8a63-09e4be2f0940 (dataset): DatasetConfig { id: 2c7b22f2-f59c-4f2f-8a63-09e4be2f0940 (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e668af9-05e3-451b-9854-6a207afe5e3d (dataset): DatasetConfig { id: 2e668af9-05e3-451b-9854-6a207afe5e3d (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 367b3548-a3f2-489a-83d3-74b47c6315bc (dataset): DatasetConfig { id: 367b3548-a3f2-489a-83d3-74b47c6315bc (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 370731fc-044a-46a5-a119-8d3c331e81ae (dataset): DatasetConfig { id: 370731fc-044a-46a5-a119-8d3c331e81ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a7fb8ea-f5cf-4c77-8d92-6295bb21aba5 (dataset): DatasetConfig { id: 3a7fb8ea-f5cf-4c77-8d92-6295bb21aba5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 417f40ee-ae59-40b1-9089-256bc4b7d466 (dataset): DatasetConfig { id: 417f40ee-ae59-40b1-9089-256bc4b7d466 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44a7b184-deee-4dcc-8106-4b70db8201a1 (dataset): DatasetConfig { id: 44a7b184-deee-4dcc-8106-4b70db8201a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45ca6340-67bc-4567-8501-20dd35f4544e (dataset): DatasetConfig { id: 45ca6340-67bc-4567-8501-20dd35f4544e (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4630ee68-18b6-4006-82c9-639961745943 (dataset): DatasetConfig { id: 4630ee68-18b6-4006-82c9-639961745943 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48e4b3bb-bfb4-49b8-8ed0-f911228251cc (dataset): DatasetConfig { id: 48e4b3bb-bfb4-49b8-8ed0-f911228251cc (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51c597d8-be33-42e4-b9b5-0cf277591b93 (dataset): DatasetConfig { id: 51c597d8-be33-42e4-b9b5-0cf277591b93 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 531678a6-0720-4980-af64-757d9b13167f (dataset): DatasetConfig { id: 531678a6-0720-4980-af64-757d9b13167f (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56a490fb-da2f-47da-9e7b-48e4c8c72e8e (dataset): DatasetConfig { id: 56a490fb-da2f-47da-9e7b-48e4c8c72e8e (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5ab496e1-ed2d-44b9-9a66-564e89e0823f (dataset): DatasetConfig { id: 5ab496e1-ed2d-44b9-9a66-564e89e0823f (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 633486ed-b832-478a-9533-d905d38ae99e (dataset): DatasetConfig { id: 633486ed-b832-478a-9533-d905d38ae99e (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6674e850-1f7d-453f-a8f5-6789ea6f9d74 (dataset): DatasetConfig { id: 6674e850-1f7d-453f-a8f5-6789ea6f9d74 (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7642f861-3481-4c7d-8df6-9db776c9a958 (dataset): DatasetConfig { id: 7642f861-3481-4c7d-8df6-9db776c9a958 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bbaa160-1d8b-47ea-b67a-38864c804bbc (dataset): DatasetConfig { id: 7bbaa160-1d8b-47ea-b67a-38864c804bbc (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c46b97c-df9a-4f87-955f-8a02fda61406 (dataset): DatasetConfig { id: 7c46b97c-df9a-4f87-955f-8a02fda61406 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 813414f0-67de-4204-b086-a03286137410 (dataset): DatasetConfig { id: 813414f0-67de-4204-b086-a03286137410 (dataset), name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 835cb62d-334d-4b50-8ba8-21016564f5e7 (dataset): DatasetConfig { id: 835cb62d-334d-4b50-8ba8-21016564f5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86871c73-c749-4c85-aea1-c0be2e33dce5 (dataset): DatasetConfig { id: 86871c73-c749-4c85-aea1-c0be2e33dce5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86b4a859-a7c2-4595-a992-7bcccf1c64bb (dataset): DatasetConfig { id: 86b4a859-a7c2-4595-a992-7bcccf1c64bb (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cbddc04-a6b3-4c3d-916d-41e0461b7932 (dataset): DatasetConfig { id: 8cbddc04-a6b3-4c3d-916d-41e0461b7932 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cdcc697-776b-4a9c-80c3-95719a4069c6 (dataset): DatasetConfig { id: 8cdcc697-776b-4a9c-80c3-95719a4069c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f3a7508-616e-4a82-a0c4-91b8327c2d1f (dataset): DatasetConfig { id: 9f3a7508-616e-4a82-a0c4-91b8327c2d1f (dataset), name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a26a53e3-8c67-494c-aec7-7ef15e787429 (dataset): DatasetConfig { id: a26a53e3-8c67-494c-aec7-7ef15e787429 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, acaee6e8-3809-4de5-b358-b0009a090394 (dataset): DatasetConfig { id: acaee6e8-3809-4de5-b358-b0009a090394 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adb94b14-804e-4f5e-b60b-633444e01083 (dataset): DatasetConfig { id: adb94b14-804e-4f5e-b60b-633444e01083 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8c0e7d7-1621-40aa-be18-0bd9373748de (dataset): DatasetConfig { id: b8c0e7d7-1621-40aa-be18-0bd9373748de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c590f269-7db6-4ae6-8a3a-da37d889c143 (dataset): DatasetConfig { id: c590f269-7db6-4ae6-8a3a-da37d889c143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c94c7c43-46cb-4389-b194-62279aeb8453 (dataset): DatasetConfig { id: c94c7c43-46cb-4389-b194-62279aeb8453 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb822d3b-3b4e-4cf0-8a34-7c347399ee61 (dataset): DatasetConfig { id: cb822d3b-3b4e-4cf0-8a34-7c347399ee61 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5aa83ed-2a66-4f55-8200-220395d9173a (dataset): DatasetConfig { id: d5aa83ed-2a66-4f55-8200-220395d9173a (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d65a3c9e-f790-42a8-93ea-d64c0876c5f3 (dataset): DatasetConfig { id: d65a3c9e-f790-42a8-93ea-d64c0876c5f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da81992a-5fec-452f-a6fd-6155e7ed8adb (dataset): DatasetConfig { id: da81992a-5fec-452f-a6fd-6155e7ed8adb (dataset), name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc897171-3927-4a73-98a5-5a4cfb7124de (dataset): DatasetConfig { id: dc897171-3927-4a73-98a5-5a4cfb7124de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb11571-0ff0-4a6c-85fe-7e5d78eadc7d (dataset): DatasetConfig { id: ddb11571-0ff0-4a6c-85fe-7e5d78eadc7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7bcc4c5-0081-4e8b-9882-e53e392f4296 (dataset): DatasetConfig { id: e7bcc4c5-0081-4e8b-9882-e53e392f4296 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ee0ac3-0a9f-454a-9985-05b81cfd552f (dataset): DatasetConfig { id: e7ee0ac3-0a9f-454a-9985-05b81cfd552f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e95dce2b-42b1-4dc5-b036-eccc577809f3 (dataset): DatasetConfig { id: e95dce2b-42b1-4dc5-b036-eccc577809f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e988c7a0-27bb-467c-aeec-fa095b4e1dce (dataset): DatasetConfig { id: e988c7a0-27bb-467c-aeec-fa095b4e1dce (dataset), name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eee7b643-07ad-4945-85d8-14b9f6473feb (dataset): DatasetConfig { id: eee7b643-07ad-4945-85d8-14b9f6473feb (dataset), name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efea2144-d845-44a9-bfce-615a424c49d0 (dataset): DatasetConfig { id: efea2144-d845-44a9-bfce-615a424c49d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f00acc27-f9d6-4715-80ba-fc34665b57da (dataset): DatasetConfig { id: f00acc27-f9d6-4715-80ba-fc34665b57da (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f118326a-c9e7-4226-af6a-7227ecb9c26c (dataset): DatasetConfig { id: f118326a-c9e7-4226-af6a-7227ecb9c26c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f1bae58e-9a21-4ec2-a495-e68bbcc67d78 (dataset): DatasetConfig { id: f1bae58e-9a21-4ec2-a495-e68bbcc67d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f9a09e03-2ed8-436a-aba8-49b18404638e (dataset): DatasetConfig { id: f9a09e03-2ed8-436a-aba8-49b18404638e (dataset), name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff9d584a-6c00-463b-9adc-4b999479eb84 (dataset): DatasetConfig { id: ff9d584a-6c00-463b-9adc-4b999479eb84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4482025-02-28T23:07:15.290ZINFOSledAgent (StorageManager): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492025-02-28T23:07:15.290ZINFOSledAgent (StorageManager): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502025-02-28T23:07:15.290ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4512025-02-28T23:07:15.305ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-02-28T23:07:15.305ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-02-28T23:07:15.305ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2" } file = sled-storage/src/manager.rs:1431
4542025-02-28T23:07:15.366ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-02-28T23:07:15.366ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562025-02-28T23:07:15.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone" } file = sled-storage/src/manager.rs:1431
4572025-02-28T23:07:15.395ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-02-28T23:07:15.395ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-02-28T23:07:15.395ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415" } file = sled-storage/src/manager.rs:1431
4602025-02-28T23:07:15.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-02-28T23:07:15.457ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622025-02-28T23:07:15.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/debug"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/debug" } file = sled-storage/src/manager.rs:1431
4632025-02-28T23:07:15.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-02-28T23:07:15.487ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-02-28T23:07:15.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d" } file = sled-storage/src/manager.rs:1431
4662025-02-28T23:07:15.547ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-02-28T23:07:15.547ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-02-28T23:07:15.547ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4692025-02-28T23:07:15.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-02-28T23:07:15.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-02-28T23:07:15.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone/oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone/oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586" } file = sled-storage/src/manager.rs:1431
4722025-02-28T23:07:15.618ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
4732025-02-28T23:07:15.656ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-02-28T23:07:15.656ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-02-28T23:07:15.656ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4762025-02-28T23:07:15.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-02-28T23:07:15.704ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4782025-02-28T23:07:15.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone" } file = sled-storage/src/manager.rs:1431
4792025-02-28T23:07:15.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-02-28T23:07:15.734ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-02-28T23:07:15.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crucible" } file = sled-storage/src/manager.rs:1431
4822025-02-28T23:07:15.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-02-28T23:07:15.783ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-02-28T23:07:15.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4852025-02-28T23:07:15.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-02-28T23:07:15.831ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-02-28T23:07:15.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0" } file = sled-storage/src/manager.rs:1431
4882025-02-28T23:07:15.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-02-28T23:07:15.891ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4902025-02-28T23:07:15.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/debug"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/debug" } file = sled-storage/src/manager.rs:1431
4912025-02-28T23:07:15.920ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-02-28T23:07:15.920ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-02-28T23:07:15.920ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4942025-02-28T23:07:15.970ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-02-28T23:07:15.970ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-02-28T23:07:15.970ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone/oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488"), full_name: "oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone/oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488" } file = sled-storage/src/manager.rs:1431
4972025-02-28T23:07:16.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-02-28T23:07:16.030ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-02-28T23:07:16.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crucible" } file = sled-storage/src/manager.rs:1431
5002025-02-28T23:07:16.079ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-02-28T23:07:16.079ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022025-02-28T23:07:16.079ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone" } file = sled-storage/src/manager.rs:1431
5032025-02-28T23:07:16.107ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-02-28T23:07:16.107ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052025-02-28T23:07:16.107ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5062025-02-28T23:07:16.136ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-02-28T23:07:16.136ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-02-28T23:07:16.136ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone/oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/zone/oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b" } file = sled-storage/src/manager.rs:1431
5092025-02-28T23:07:16.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-02-28T23:07:16.195ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-02-28T23:07:16.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/zone/oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19"), full_name: "oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/zone/oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19" } file = sled-storage/src/manager.rs:1431
5122025-02-28T23:07:16.253ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-02-28T23:07:16.253ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5142025-02-28T23:07:16.253ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/debug"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/debug" } file = sled-storage/src/manager.rs:1431
5152025-02-28T23:07:16.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-02-28T23:07:16.281ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-02-28T23:07:16.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5182025-02-28T23:07:16.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-02-28T23:07:16.331ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-02-28T23:07:16.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2" } file = sled-storage/src/manager.rs:1431
5212025-02-28T23:07:16.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-02-28T23:07:16.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232025-02-28T23:07:16.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c" } file = sled-storage/src/manager.rs:1431
5242025-02-28T23:07:16.449ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-02-28T23:07:16.449ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-02-28T23:07:16.449ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f" } file = sled-storage/src/manager.rs:1431
5272025-02-28T23:07:16.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-02-28T23:07:16.509ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-02-28T23:07:16.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2" } file = sled-storage/src/manager.rs:1431
5302025-02-28T23:07:16.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-02-28T23:07:16.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-02-28T23:07:16.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crucible" } file = sled-storage/src/manager.rs:1431
5332025-02-28T23:07:16.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342025-02-28T23:07:16.615ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352025-02-28T23:07:16.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408" } file = sled-storage/src/manager.rs:1431
5362025-02-28T23:07:16.620ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
5372025-02-28T23:07:16.675ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-02-28T23:07:16.675ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-02-28T23:07:16.675ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476" } file = sled-storage/src/manager.rs:1431
5402025-02-28T23:07:16.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-02-28T23:07:16.735ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5422025-02-28T23:07:16.735ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5534d82-e391-4535-be4a-591aedf1d99f/crypt/debug"), full_name: "oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5432025-02-28T23:07:16.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-02-28T23:07:16.764ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5452025-02-28T23:07:16.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone"), full_name: "oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5462025-02-28T23:07:16.793ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-02-28T23:07:16.793ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-02-28T23:07:16.793ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-02-28T23:07:16.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-02-28T23:07:16.822ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-02-28T23:07:16.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crucible" } file = sled-storage/src/manager.rs:1431
5522025-02-28T23:07:16.869ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-02-28T23:07:16.869ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-02-28T23:07:16.869ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crucible" } file = sled-storage/src/manager.rs:1431
5552025-02-28T23:07:16.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-02-28T23:07:16.919ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572025-02-28T23:07:16.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2" } file = sled-storage/src/manager.rs:1431
5582025-02-28T23:07:16.977ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-02-28T23:07:16.977ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5602025-02-28T23:07:16.977ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/zone"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/zone" } file = sled-storage/src/manager.rs:1431
5612025-02-28T23:07:17.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-02-28T23:07:17.008ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-02-28T23:07:17.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5642025-02-28T23:07:17.057ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-02-28T23:07:17.057ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5662025-02-28T23:07:17.057ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/debug"), full_name: "oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/debug" } file = sled-storage/src/manager.rs:1431
5672025-02-28T23:07:17.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-02-28T23:07:17.087ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-02-28T23:07:17.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5702025-02-28T23:07:17.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-02-28T23:07:17.139ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722025-02-28T23:07:17.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone/oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b" } file = sled-storage/src/manager.rs:1431
5732025-02-28T23:07:17.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-02-28T23:07:17.199ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-02-28T23:07:17.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crucible" } file = sled-storage/src/manager.rs:1431
5762025-02-28T23:07:17.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-02-28T23:07:17.246ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-02-28T23:07:17.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5792025-02-28T23:07:17.298ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-02-28T23:07:17.298ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5812025-02-28T23:07:17.298ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/zone"), full_name: "oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/zone" } file = sled-storage/src/manager.rs:1431
5822025-02-28T23:07:17.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-02-28T23:07:17.327ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-02-28T23:07:17.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50" } file = sled-storage/src/manager.rs:1431
5852025-02-28T23:07:17.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-02-28T23:07:17.385ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-02-28T23:07:17.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible" } file = sled-storage/src/manager.rs:1431
5882025-02-28T23:07:17.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-02-28T23:07:17.433ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-02-28T23:07:17.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96" } file = sled-storage/src/manager.rs:1431
5912025-02-28T23:07:17.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-02-28T23:07:17.494ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5932025-02-28T23:07:17.494ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/debug"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/debug" } file = sled-storage/src/manager.rs:1431
5942025-02-28T23:07:17.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-02-28T23:07:17.523ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-02-28T23:07:17.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/zone/oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252" } file = sled-storage/src/manager.rs:1431
5972025-02-28T23:07:17.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-02-28T23:07:17.586ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5992025-02-28T23:07:17.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/zone" } file = sled-storage/src/manager.rs:1431
6002025-02-28T23:07:17.614ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-02-28T23:07:17.614ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-02-28T23:07:17.614ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08" } file = sled-storage/src/manager.rs:1431
6032025-02-28T23:07:17.625ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6042025-02-28T23:07:17.675ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-02-28T23:07:17.675ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-02-28T23:07:17.675ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6072025-02-28T23:07:17.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-02-28T23:07:17.726ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6092025-02-28T23:07:17.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/debug"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/debug" } file = sled-storage/src/manager.rs:1431
6102025-02-28T23:07:17.755ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-02-28T23:07:17.755ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-02-28T23:07:17.755ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6132025-02-28T23:07:17.805ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-02-28T23:07:17.805ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-02-28T23:07:17.805ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crucible" } file = sled-storage/src/manager.rs:1431
6162025-02-28T23:07:17.854ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-02-28T23:07:17.854ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-02-28T23:07:17.854ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc" } file = sled-storage/src/manager.rs:1431
6192025-02-28T23:07:17.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-02-28T23:07:17.917ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-02-28T23:07:17.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/zone/oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb" } file = sled-storage/src/manager.rs:1431
6222025-02-28T23:07:17.977ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-02-28T23:07:17.977ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-02-28T23:07:17.977ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2" } file = sled-storage/src/manager.rs:1431
6252025-02-28T23:07:18.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-02-28T23:07:18.039ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-02-28T23:07:18.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec" } file = sled-storage/src/manager.rs:1431
6282025-02-28T23:07:18.099ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-02-28T23:07:18.099ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-02-28T23:07:18.099ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b"), full_name: "oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/zone/oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b" } file = sled-storage/src/manager.rs:1431
6312025-02-28T23:07:18.161ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-02-28T23:07:18.161ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-02-28T23:07:18.161ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0"), full_name: "oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/zone/oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0" } file = sled-storage/src/manager.rs:1431
6342025-02-28T23:07:18.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-02-28T23:07:18.221ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-02-28T23:07:18.221ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f"), full_name: "oxp_9395a765-3cd5-4500-919f-891f129f4358/crypt/zone/oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f" } file = sled-storage/src/manager.rs:1431
6372025-02-28T23:07:18.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-02-28T23:07:18.284ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-02-28T23:07:18.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6402025-02-28T23:07:18.335ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-02-28T23:07:18.335ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6422025-02-28T23:07:18.335ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/debug"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/debug" } file = sled-storage/src/manager.rs:1431
6432025-02-28T23:07:18.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-02-28T23:07:18.365ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6452025-02-28T23:07:18.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/debug"), full_name: "oxp_e6859987-fd24-4257-800d-91c0f9f61334/crypt/debug" } file = sled-storage/src/manager.rs:1431
6462025-02-28T23:07:18.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-02-28T23:07:18.394ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-02-28T23:07:18.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone/oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a"), full_name: "oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crypt/zone/oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a" } file = sled-storage/src/manager.rs:1431
6492025-02-28T23:07:18.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-02-28T23:07:18.456ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512025-02-28T23:07:18.456ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crucible" } file = sled-storage/src/manager.rs:1431
6522025-02-28T23:07:18.505ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532025-02-28T23:07:18.505ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542025-02-28T23:07:18.506ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6552025-02-28T23:07:18.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3216361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56334 req_id = 1afd7fca-f66e-42ba-a16b-9636fe81b661 response_code = 200 uri = /datasets
6562025-02-28T23:07:18.537ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5e06f04e-ce57-413e-9b0c-0b81b85bbe50 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 879630cc-2671-4ee9-8650-0f0266d052f2 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: b1a15522-b7b4-4549-b93c-db325c92868f (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6572025-02-28T23:07:18.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62470
6582025-02-28T23:07:18.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-02-28T23:07:18.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-02-28T23:07:18.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-02-28T23:07:18.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-02-28T23:07:18.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632025-02-28T23:07:18.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642025-02-28T23:07:18.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-02-28T23:07:18.565ZINFOSledAgent (ServiceManager): No ledger in /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-02-28T23:07:18.565ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:188
6672025-02-28T23:07:18.565ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6682025-02-28T23:07:18.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-02-28T23:07:18.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-02-28T23:07:18.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-02-28T23:07:18.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-02-28T23:07:18.630ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6732025-02-28T23:07:18.663ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50 file = illumos-utils/src/zone.rs:325
6742025-02-28T23:07:18.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f file = illumos-utils/src/zone.rs:325
6752025-02-28T23:07:18.670ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2 file = illumos-utils/src/zone.rs:325
6762025-02-28T23:07:18.682ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50 file = illumos-utils/src/zone.rs:363
6772025-02-28T23:07:18.686ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f file = illumos-utils/src/zone.rs:363
6782025-02-28T23:07:18.690ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2 file = illumos-utils/src/zone.rs:363
6792025-02-28T23:07:18.987ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.175426008s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6802025-02-28T23:07:19.633ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/probe_manager.rs:238 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6812025-02-28T23:07:20.375ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822025-02-28T23:07:20.375ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6832025-02-28T23:07:20.857ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842025-02-28T23:07:21.335ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6852025-02-28T23:07:21.335ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862025-02-28T23:07:21.336ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
6872025-02-28T23:07:21.340ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6882025-02-28T23:07:21.340ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
6892025-02-28T23:07:21.344ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
6902025-02-28T23:07:21.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 45.069166ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
6912025-02-28T23:07:21.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 71.584296ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
6922025-02-28T23:07:21.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 53.050333ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
6932025-02-28T23:07:21.483ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7777878587194776716 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6942025-02-28T23:07:21.483ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 133391468299131197 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
6952025-02-28T23:07:21.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 99.725756ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
6962025-02-28T23:07:21.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 116.024388ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
6972025-02-28T23:07:21.722ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
6982025-02-28T23:07:21.722ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
6992025-02-28T23:07:21.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 115.935678ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7002025-02-28T23:07:21.937ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
7012025-02-28T23:07:21.942ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
7022025-02-28T23:07:21.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 180.250899ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7032025-02-28T23:07:22.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 215.240184ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7042025-02-28T23:07:22.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 245.944865ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7052025-02-28T23:07:22.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2669570204347805593 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
7062025-02-28T23:07:22.242ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 875424460270775760 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
7072025-02-28T23:07:22.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 390.10445ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7082025-02-28T23:07:22.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 562.709586ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7092025-02-28T23:07:22.396ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
7102025-02-28T23:07:22.396ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
7112025-02-28T23:07:22.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 557.349644ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7122025-02-28T23:07:22.441ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
7132025-02-28T23:07:22.441ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
7142025-02-28T23:07:22.503ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
7152025-02-28T23:07:22.503ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
7162025-02-28T23:07:22.530ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
7172025-02-28T23:07:22.530ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
7182025-02-28T23:07:22.622ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
7192025-02-28T23:07:22.622ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
7202025-02-28T23:07:22.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 927.897759ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7212025-02-28T23:07:22.722ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7222025-02-28T23:07:22.722ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7232025-02-28T23:07:22.826ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7242025-02-28T23:07:22.827ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7252025-02-28T23:07:22.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 1.004276256s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7262025-02-28T23:07:22.863ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/eb977560-79bb-4094-9f3c-0c8f67caef5b) file = sled-agent/src/nexus.rs:530 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
7272025-02-28T23:07:22.863ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7282025-02-28T23:07:22.895ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7292025-02-28T23:07:22.896ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7302025-02-28T23:07:22.896ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7312025-02-28T23:07:22.896ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7322025-02-28T23:07:22.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7332025-02-28T23:07:22.990ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7342025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7352025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7362025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7372025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7382025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7392025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7402025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7412025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7422025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7432025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7442025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7452025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7462025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7472025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7482025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7492025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7502025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7512025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7522025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7532025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7542025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7552025-02-28T23:07:22.990ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7562025-02-28T23:07:22.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 881.476729ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7572025-02-28T23:07:23.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 1.2561451s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7582025-02-28T23:07:23.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 1.247796962s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7592025-02-28T23:07:23.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 776.094595ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7602025-02-28T23:07:24.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 1.289259257s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7612025-02-28T23:07:24.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 551.211191ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7622025-02-28T23:07:25.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 1.089367155s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7632025-02-28T23:07:25.407ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 987.894087ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7642025-02-28T23:07:25.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f") failed: Property not found. retry in 932.626028ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7652025-02-28T23:07:26.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50") failed: Property not found. retry in 712.431084ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7662025-02-28T23:07:26.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2") failed: Property not found. retry in 1.427246866s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7672025-02-28T23:07:27.850ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_5e06f04e-ce57-413e-9b0c-0b81b85bbe50
7682025-02-28T23:07:27.850ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_b1a15522-b7b4-4549-b93c-db325c92868f
7692025-02-28T23:07:27.850ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_879630cc-2671-4ee9-8650-0f0266d052f2
7702025-02-28T23:07:27.850ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712025-02-28T23:07:27.850ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-02-28T23:07:27.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9312947 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62470 req_id = ad2d762b-7801-4385-8a7d-60ed020823a8 response_code = 204 uri = /omicron-zones
7732025-02-28T23:07:27.852ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-02-28T23:07:28.030ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 120.896045ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7752025-02-28T23:07:28.217ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762025-02-28T23:07:28.319ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-02-28T23:07:28.423ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7782025-02-28T23:07:28.423ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7792025-02-28T23:07:28.454ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7802025-02-28T23:07:28.455ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7812025-02-28T23:07:28.455ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7822025-02-28T23:07:28.484ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5e06f04e-ce57-413e-9b0c-0b81b85bbe50 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 879630cc-2671-4ee9-8650-0f0266d052f2 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: b1a15522-b7b4-4549-b93c-db325c92868f (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 (service), filesystem_pool: Some(ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 839cbbfe-dbda-4da0-ac94-b00a4da6bb00, kind: Service { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 }, name: Name("ntp-12aa3781-9be5-4ea0-ab6d-0af134588488"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 237])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7832025-02-28T23:07:28.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44557
7842025-02-28T23:07:28.484ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-02-28T23:07:28.484ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-02-28T23:07:28.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-02-28T23:07:28.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-02-28T23:07:28.505ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892025-02-28T23:07:28.505ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902025-02-28T23:07:28.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912025-02-28T23:07:28.514ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
7922025-02-28T23:07:28.514ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
7932025-02-28T23:07:28.514ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7942025-02-28T23:07:28.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-02-28T23:07:28.526ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7962025-02-28T23:07:28.558ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7972025-02-28T23:07:28.559ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7982025-02-28T23:07:28.559ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7992025-02-28T23:07:28.589ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 149, 237]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8002025-02-28T23:07:28.589ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
8012025-02-28T23:07:28.589ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8022025-02-28T23:07:28.589ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8032025-02-28T23:07:28.590ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8042025-02-28T23:07:28.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8052025-02-28T23:07:28.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488 file = illumos-utils/src/zone.rs:325
8062025-02-28T23:07:28.631ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488 file = illumos-utils/src/zone.rs:363
8072025-02-28T23:07:29.282ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8082025-02-28T23:07:29.282ZINFOSledAgent (ServiceManager): Booting oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8092025-02-28T23:07:29.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 30.602665ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8102025-02-28T23:07:29.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 140.461881ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8112025-02-28T23:07:29.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 203.200786ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8122025-02-28T23:07:29.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 264.984863ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8132025-02-28T23:07:30.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 1.124574852s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8142025-02-28T23:07:31.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 1.044806023s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8152025-02-28T23:07:31.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7777878587194776716 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8162025-02-28T23:07:31.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 133391468299131197 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8172025-02-28T23:07:32.242ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2669570204347805593 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8182025-02-28T23:07:32.242ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 875424460270775760 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8192025-02-28T23:07:32.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 998.2265ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8202025-02-28T23:07:33.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 1.029596051s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8212025-02-28T23:07:34.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 1.071790896s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8222025-02-28T23:07:35.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488") failed: Property not found. retry in 602.205755ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8232025-02-28T23:07:36.036ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488
8242025-02-28T23:07:36.036ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8252025-02-28T23:07:36.036ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8262025-02-28T23:07:36.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7552833 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44557 req_id = 40be311d-3fb1-47b6-8e8c-c7989c42c772 response_code = 204 uri = /omicron-zones
8272025-02-28T23:07:36.039ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8282025-02-28T23:07:36.069ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-02-28T23:07:36.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37985
8302025-02-28T23:07:36.079ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8312025-02-28T23:07:36.079ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 10034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37985 req_id = 58fe7cb1-36ab-452c-a951-57cf2c27c197 response_code = 500 uri = /timesync
8322025-02-28T23:07:36.082ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-02-28T23:07:36.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-02-28T23:07:36.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60078
8352025-02-28T23:07:40.238ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8362025-02-28T23:07:40.239ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60078 req_id = 74591c62-d587-41cc-aed6-85b9c8810644 response_code = 500 uri = /timesync
8372025-02-28T23:07:40.240ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6437232632569796948 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8382025-02-28T23:07:40.240ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 541186462925846803 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8392025-02-28T23:07:40.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13457914618067042146 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8402025-02-28T23:07:40.242ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-02-28T23:07:40.369ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-02-28T23:07:40.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47251
8432025-02-28T23:07:40.377ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8442025-02-28T23:07:40.378ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47251 req_id = 30642869-fc97-4dd7-8f44-b3c68a94c40d response_code = 500 uri = /timesync
8452025-02-28T23:07:40.381ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-02-28T23:07:40.560ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-02-28T23:07:40.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40118
8482025-02-28T23:07:41.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7777878587194776716 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8492025-02-28T23:07:41.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 133391468299131197 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8502025-02-28T23:07:42.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2669570204347805593 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8512025-02-28T23:07:42.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 875424460270775760 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
8522025-02-28T23:07:44.573ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12aa3781-9be5-4ea0-ab6d-0af134588488': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8532025-02-28T23:07:44.573ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008857 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40118 req_id = 8a41dbda-b281-4ca8-9293-2ec01aa41ee9 response_code = 500 uri = /timesync
8542025-02-28T23:07:44.575ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552025-02-28T23:07:44.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562025-02-28T23:07:44.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56741
8572025-02-28T23:07:44.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56741 req_id = 35975271-59ea-4768-9766-9f020179d99c response_code = 200 uri = /timesync
8582025-02-28T23:07:44.767ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.037425179 } file = sled-agent/src/rack_setup/service.rs:743
8592025-02-28T23:07:44.767ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602025-02-28T23:07:45.013ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-02-28T23:07:45.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42066
8622025-02-28T23:07:45.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 20598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42066 req_id = 1a047ece-f8b1-48cd-95bc-4090db89466e response_code = 200 uri = /timesync
8632025-02-28T23:07:45.037ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1740784064.5093362, correction: 0.037029184 } file = sled-agent/src/rack_setup/service.rs:743
8642025-02-28T23:07:45.037ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
8652025-02-28T23:07:45.067ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5e06f04e-ce57-413e-9b0c-0b81b85bbe50 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 879630cc-2671-4ee9-8650-0f0266d052f2 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: b1a15522-b7b4-4549-b93c-db325c92868f (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 (service), filesystem_pool: Some(ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 839cbbfe-dbda-4da0-ac94-b00a4da6bb00, kind: Service { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 }, name: Name("ntp-12aa3781-9be5-4ea0-ab6d-0af134588488"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 237])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: ffe24471-f34e-4d27-95c8-5ab35e93b476 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a0d7cac4-1ff7-4ded-b5a8-17dda058abf0 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 81537c11-1059-4f7b-b9e1-17ea068949b0 (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c1699485-1789-4422-bcfe-cc0c3b62bb96 (service), filesystem_pool: Some(ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9afee5b4-ccff-4ad4-a54a-f9a6913fe586 (service), filesystem_pool: Some(ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8662025-02-28T23:07:45.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40969
8672025-02-28T23:07:45.067ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8682025-02-28T23:07:45.067ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8692025-02-28T23:07:45.077ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8702025-02-28T23:07:45.077ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712025-02-28T23:07:45.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-02-28T23:07:45.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732025-02-28T23:07:45.097ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-02-28T23:07:45.097ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, responder: ... }
8752025-02-28T23:07:45.106ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-02-28T23:07:45.106ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772025-02-28T23:07:45.115ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-02-28T23:07:45.115ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-02-28T23:07:45.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-02-28T23:07:45.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-02-28T23:07:45.133ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822025-02-28T23:07:45.133ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832025-02-28T23:07:45.143ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8842025-02-28T23:07:45.143ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
8852025-02-28T23:07:45.143ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
8862025-02-28T23:07:45.143ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
8872025-02-28T23:07:45.143ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8882025-02-28T23:07:45.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8892025-02-28T23:07:45.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8902025-02-28T23:07:45.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8912025-02-28T23:07:45.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8922025-02-28T23:07:45.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8932025-02-28T23:07:45.320ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476 file = illumos-utils/src/zone.rs:325
8942025-02-28T23:07:45.324ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 file = illumos-utils/src/zone.rs:325
8952025-02-28T23:07:45.328ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96 file = illumos-utils/src/zone.rs:325
8962025-02-28T23:07:45.332ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0 file = illumos-utils/src/zone.rs:325
8972025-02-28T23:07:45.337ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586 file = illumos-utils/src/zone.rs:325
8982025-02-28T23:07:45.341ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476 file = illumos-utils/src/zone.rs:363
8992025-02-28T23:07:45.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 file = illumos-utils/src/zone.rs:363
9002025-02-28T23:07:45.350ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96 file = illumos-utils/src/zone.rs:363
9012025-02-28T23:07:45.354ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0 file = illumos-utils/src/zone.rs:363
9022025-02-28T23:07:45.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586 file = illumos-utils/src/zone.rs:363
9032025-02-28T23:07:48.905ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a0d7cac4-1ff7-4ded-b5a8-17dda058abf0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9042025-02-28T23:07:48.905ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9052025-02-28T23:07:48.954ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9afee5b4-ccff-4ad4-a54a-f9a6913fe586'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062025-02-28T23:07:48.954ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ffe24471-f34e-4d27-95c8-5ab35e93b476'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072025-02-28T23:07:48.955ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9082025-02-28T23:07:49.002ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9092025-02-28T23:07:49.019ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c1699485-1789-4422-bcfe-cc0c3b62bb96'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102025-02-28T23:07:49.020ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9112025-02-28T23:07:49.133ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='81537c11-1059-4f7b-b9e1-17ea068949b0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9122025-02-28T23:07:49.133ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9132025-02-28T23:07:49.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 40.59365ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9142025-02-28T23:07:49.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 57.489821ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9152025-02-28T23:07:49.250ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 46.987009ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9162025-02-28T23:07:49.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 30.305035ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9172025-02-28T23:07:49.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 133.80163ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9182025-02-28T23:07:49.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 99.857053ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9192025-02-28T23:07:49.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 73.318052ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9202025-02-28T23:07:49.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 118.281371ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9212025-02-28T23:07:49.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 96.416421ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9222025-02-28T23:07:49.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 69.314497ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9232025-02-28T23:07:49.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 154.276339ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9242025-02-28T23:07:49.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 161.336601ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9252025-02-28T23:07:49.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 215.174748ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9262025-02-28T23:07:49.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 281.260995ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9272025-02-28T23:07:49.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 294.201926ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9282025-02-28T23:07:49.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 254.783047ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9292025-02-28T23:07:49.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 557.614649ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9302025-02-28T23:07:49.714ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 208.813862ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9312025-02-28T23:07:49.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 364.235889ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9322025-02-28T23:07:49.822ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 216.379029ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9332025-02-28T23:07:49.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 703.781182ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9342025-02-28T23:07:49.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.164215864s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9352025-02-28T23:07:50.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 881.686329ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9362025-02-28T23:07:50.168ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 529.879731ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9372025-02-28T23:07:50.225ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 437.302318ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9382025-02-28T23:07:50.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 947.181605ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9392025-02-28T23:07:50.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.178212671s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9402025-02-28T23:07:50.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.368391874s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9412025-02-28T23:07:50.944ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 996.054702ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9422025-02-28T23:07:51.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.313976772s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9432025-02-28T23:07:51.255ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 216.807265ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
9442025-02-28T23:07:51.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 779.061249ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9452025-02-28T23:07:51.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.396509281s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9462025-02-28T23:07:51.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.011340213s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9472025-02-28T23:07:52.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.301189687s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9482025-02-28T23:07:52.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 1.482153899s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9492025-02-28T23:07:52.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.274625663s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9502025-02-28T23:07:52.438ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46386
9512025-02-28T23:07:52.438ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46386 req_id = cec75017-ed14-4a4c-ab82-b0c70908a5b4 response_code = 200 uri = /baseboard
9522025-02-28T23:07:52.975ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 667.954292ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9532025-02-28T23:07:53.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.33310239s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9542025-02-28T23:07:53.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.232356062s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9552025-02-28T23:07:53.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.44525733s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9562025-02-28T23:07:53.724ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 783.422545ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9572025-02-28T23:07:53.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 790.629267ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9582025-02-28T23:07:54.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.264429654s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9592025-02-28T23:07:54.621ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.061817732s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9602025-02-28T23:07:54.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.227747487s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9612025-02-28T23:07:54.666ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 1.347871177s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9622025-02-28T23:07:55.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 986.33485ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9632025-02-28T23:07:55.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.039872859s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9642025-02-28T23:07:55.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.348715683s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9652025-02-28T23:07:55.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.213218017s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9662025-02-28T23:07:56.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 995.727392ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9672025-02-28T23:07:56.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.412811909s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9682025-02-28T23:07:56.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.21369575s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9692025-02-28T23:07:57.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 1.455057425s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9702025-02-28T23:07:57.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 522.762562ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9712025-02-28T23:07:57.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 671.751533ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9722025-02-28T23:07:57.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 701.010567ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9732025-02-28T23:07:57.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.1075152s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9742025-02-28T23:07:57.843ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.000113289s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9752025-02-28T23:07:57.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.477015248s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9762025-02-28T23:07:58.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.168186313s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9772025-02-28T23:07:58.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 934.567248ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9782025-02-28T23:07:58.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 663.667868ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9792025-02-28T23:07:58.854ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.242124776s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9802025-02-28T23:07:59.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 514.851226ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9812025-02-28T23:07:59.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 1.155474141s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9822025-02-28T23:07:59.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 546.322494ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9832025-02-28T23:07:59.463ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.142032107s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9842025-02-28T23:07:59.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.109170465s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9852025-02-28T23:08:00.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.080316547s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9862025-02-28T23:08:00.106ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 1.291302625s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9872025-02-28T23:08:00.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476") failed: Property not found. retry in 1.124698074s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9882025-02-28T23:08:00.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0") failed: Property not found. retry in 1.172261763s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9892025-02-28T23:08:01.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0") failed: Property not found. retry in 1.253735356s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9902025-02-28T23:08:01.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 556.836053ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9912025-02-28T23:08:01.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96") failed: Property not found. retry in 611.594375ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9922025-02-28T23:08:01.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586") failed: Property not found. retry in 1.165237492s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9932025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_ffe24471-f34e-4d27-95c8-5ab35e93b476
9942025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0
9952025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_c1699485-1789-4422-bcfe-cc0c3b62bb96
9962025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_a0d7cac4-1ff7-4ded-b5a8-17dda058abf0
9972025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_9afee5b4-ccff-4ad4-a54a-f9a6913fe586
9982025-02-28T23:08:02.854ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9992025-02-28T23:08:02.855ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10002025-02-28T23:08:02.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17751624 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40969 req_id = 2822074a-a884-4856-91c0-1fa12a7f2264 response_code = 204 uri = /omicron-zones
10012025-02-28T23:08:02.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52256
10022025-02-28T23:08:02.917ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 42ace3ef-bda1-49f3-bb77-0ffc8f9e06a2 response_code = 500 uri = /cockroachdb
10032025-02-28T23:08:02.917ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "42ace3ef-bda1-49f3-bb77-0ffc8f9e06a2", "content-length": "124", "date": "Fri, 28 Feb 2025 23:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "42ace3ef-bda1-49f3-bb77-0ffc8f9e06a2" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 113.788355ms
10042025-02-28T23:08:03.064ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 31355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 4bde899a-47f7-417e-86b8-5d1d463a6b30 response_code = 500 uri = /cockroachdb
10052025-02-28T23:08:03.064ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4bde899a-47f7-417e-86b8-5d1d463a6b30", "content-length": "124", "date": "Fri, 28 Feb 2025 23:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4bde899a-47f7-417e-86b8-5d1d463a6b30" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 137.368926ms
10062025-02-28T23:08:03.230ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 4333c563-6576-485e-8c2d-fe765bdb10d9 response_code = 500 uri = /cockroachdb
10072025-02-28T23:08:03.231ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4333c563-6576-485e-8c2d-fe765bdb10d9", "content-length": "124", "date": "Fri, 28 Feb 2025 23:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4333c563-6576-485e-8c2d-fe765bdb10d9" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 76.556164ms
10082025-02-28T23:08:03.333ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 986dc773-6df8-4414-bfe8-a3d4d2056305 response_code = 500 uri = /cockroachdb
10092025-02-28T23:08:03.334ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "986dc773-6df8-4414-bfe8-a3d4d2056305", "content-length": "124", "date": "Fri, 28 Feb 2025 23:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "986dc773-6df8-4414-bfe8-a3d4d2056305" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 176.70014ms
10102025-02-28T23:08:03.536ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_81537c11-1059-4f7b-b9e1-17ea068949b0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 9b196fe1-5d08-403c-84e7-9ef4b2491d1b response_code = 500 uri = /cockroachdb
10112025-02-28T23:08:03.536ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9b196fe1-5d08-403c-84e7-9ef4b2491d1b", "content-length": "124", "date": "Fri, 28 Feb 2025 23:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9b196fe1-5d08-403c-84e7-9ef4b2491d1b" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 194.675793ms
10122025-02-28T23:08:03.763ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3852
10132025-02-28T23:08:16.195ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
10142025-02-28T23:08:22.455ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
10152025-02-28T23:08:22.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 18722893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52256 req_id = 1fd51605-7315-442c-bc0b-d455a8e09390 response_code = 204 uri = /cockroachdb
10162025-02-28T23:08:22.470ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 366.505991ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
10172025-02-28T23:08:22.499ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56279
10182025-02-28T23:08:22.500ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 390 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56279 req_id = 496c5c60-a261-4dbc-9a15-c4cf32fbdd48 response_code = 200 uri = /baseboard
10192025-02-28T23:08:22.503ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5e06f04e-ce57-413e-9b0c-0b81b85bbe50 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 879630cc-2671-4ee9-8650-0f0266d052f2 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: b1a15522-b7b4-4549-b93c-db325c92868f (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 (service), filesystem_pool: Some(ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 839cbbfe-dbda-4da0-ac94-b00a4da6bb00, kind: Service { id: 12aa3781-9be5-4ea0-ab6d-0af134588488 }, name: Name("ntp-12aa3781-9be5-4ea0-ab6d-0af134588488"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 237])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: ffe24471-f34e-4d27-95c8-5ab35e93b476 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a0d7cac4-1ff7-4ded-b5a8-17dda058abf0 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 81537c11-1059-4f7b-b9e1-17ea068949b0 (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c1699485-1789-4422-bcfe-cc0c3b62bb96 (service), filesystem_pool: Some(ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9afee5b4-ccff-4ad4-a54a-f9a6913fe586 (service), filesystem_pool: Some(ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: b0e3cb3e-c072-4223-920e-1364ded6c14d (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 431cd3aa-3cd0-477f-978b-e37653464252 (service), filesystem_pool: Some(ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 (service), filesystem_pool: Some(ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b (service), filesystem_pool: Some(ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 14040373-b27e-4ea2-b873-16b58932afec (service), filesystem_pool: Some(ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: b76b0ba8-47ba-4bfc-8a97-b369297e1415 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 27ccf5d2-b51e-473e-8c99-6d654e6576b2 (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4ea9a82e-2bb1-465c-b67c-e820ca18a36b (service), filesystem_pool: Some(ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2 (service), filesystem_pool: Some(ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: ae10da9e-d02f-4c25-925c-6b3256cfed7f (service), filesystem_pool: Some(ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c58a709c-6408-4add-a379-1443327e0f08 (service), filesystem_pool: Some(ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 93200bf6-e9f2-485e-8e7d-bd7075ff8cc2 (service), filesystem_pool: Some(ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1b513750-0007-4ce9-b36a-deb831551c9c (service), filesystem_pool: Some(ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a3b92681-ed11-475b-b75d-7d992dc3612b (service), filesystem_pool: Some(ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7a11c084-2890-4137-9a8e-e027a350cf19 (service), filesystem_pool: Some(ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 398ab3fa-658b-4d3e-9c99-f5715ac4e4dc (service), filesystem_pool: Some(ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 52ad7911-a790-442e-97d6-87d129f12408 (service), filesystem_pool: Some(ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: de3be315-72e8-4256-af1b-17017cdd9a8a (service), filesystem_pool: Some(ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10202025-02-28T23:08:22.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33554
10212025-02-28T23:08:22.504ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10222025-02-28T23:08:22.504ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232025-02-28T23:08:22.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10242025-02-28T23:08:22.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10252025-02-28T23:08:22.531ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10262025-02-28T23:08:22.531ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10272025-02-28T23:08:22.543ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10282025-02-28T23:08:22.543ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292025-02-28T23:08:22.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10302025-02-28T23:08:22.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312025-02-28T23:08:22.568ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10322025-02-28T23:08:22.568ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332025-02-28T23:08:22.578ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10342025-02-28T23:08:22.578ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10352025-02-28T23:08:22.589ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10362025-02-28T23:08:22.589ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10372025-02-28T23:08:22.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10382025-02-28T23:08:22.599ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10392025-02-28T23:08:22.609ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-02-28T23:08:22.609ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10412025-02-28T23:08:22.626ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-02-28T23:08:22.626ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10432025-02-28T23:08:22.636ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-02-28T23:08:22.636ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, kind: Crucible }, responder: ... }
10452025-02-28T23:08:22.646ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-02-28T23:08:22.646ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, kind: Crucible }, responder: ... }
10472025-02-28T23:08:22.657ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-02-28T23:08:22.657ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, kind: Crucible }, responder: ... }
10492025-02-28T23:08:22.666ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-02-28T23:08:22.667ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, kind: Crucible }, responder: ... }
10512025-02-28T23:08:22.677ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-02-28T23:08:22.677ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10532025-02-28T23:08:22.688ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-02-28T23:08:22.688ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, kind: Crucible }, responder: ... }
10552025-02-28T23:08:22.699ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-02-28T23:08:22.699ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, kind: Crucible }, responder: ... }
10572025-02-28T23:08:22.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-02-28T23:08:22.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, kind: Crucible }, responder: ... }
10592025-02-28T23:08:22.725ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-02-28T23:08:22.725ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, kind: Crucible }, responder: ... }
10612025-02-28T23:08:22.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10622025-02-28T23:08:22.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
10632025-02-28T23:08:22.736ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
10642025-02-28T23:08:22.736ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
10652025-02-28T23:08:22.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10662025-02-28T23:08:22.913ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10672025-02-28T23:08:22.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10682025-02-28T23:08:22.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10692025-02-28T23:08:22.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10702025-02-28T23:08:22.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10712025-02-28T23:08:22.928ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10722025-02-28T23:08:22.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10732025-02-28T23:08:22.940ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10742025-02-28T23:08:22.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10752025-02-28T23:08:22.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10762025-02-28T23:08:23.142ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10772025-02-28T23:08:23.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782025-02-28T23:08:23.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10792025-02-28T23:08:23.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10802025-02-28T23:08:23.144ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10812025-02-28T23:08:23.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822025-02-28T23:08:23.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832025-02-28T23:08:23.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10842025-02-28T23:08:23.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852025-02-28T23:08:23.160ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f file = illumos-utils/src/zone.rs:325
10862025-02-28T23:08:23.166ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08 file = illumos-utils/src/zone.rs:325
10872025-02-28T23:08:23.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2 file = illumos-utils/src/zone.rs:325
10882025-02-28T23:08:23.176ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a file = illumos-utils/src/zone.rs:325
10892025-02-28T23:08:23.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415 file = illumos-utils/src/zone.rs:325
10902025-02-28T23:08:23.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c file = illumos-utils/src/zone.rs:325
10912025-02-28T23:08:23.192ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19 file = illumos-utils/src/zone.rs:325
10922025-02-28T23:08:23.326ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f file = illumos-utils/src/zone.rs:363
10932025-02-28T23:08:23.330ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08 file = illumos-utils/src/zone.rs:363
10942025-02-28T23:08:23.335ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2 file = illumos-utils/src/zone.rs:363
10952025-02-28T23:08:23.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a file = illumos-utils/src/zone.rs:363
10962025-02-28T23:08:23.343ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415 file = illumos-utils/src/zone.rs:363
10972025-02-28T23:08:23.348ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c file = illumos-utils/src/zone.rs:363
10982025-02-28T23:08:23.353ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19 file = illumos-utils/src/zone.rs:363
10992025-02-28T23:08:23.359ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2 file = illumos-utils/src/zone.rs:325
11002025-02-28T23:08:23.363ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc file = illumos-utils/src/zone.rs:325
11012025-02-28T23:08:23.367ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408 file = illumos-utils/src/zone.rs:325
11022025-02-28T23:08:23.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b file = illumos-utils/src/zone.rs:325
11032025-02-28T23:08:23.378ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec file = illumos-utils/src/zone.rs:325
11042025-02-28T23:08:23.383ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2 file = illumos-utils/src/zone.rs:325
11052025-02-28T23:08:23.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b file = illumos-utils/src/zone.rs:325
11062025-02-28T23:08:23.453ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11072025-02-28T23:08:23.453ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2 file = illumos-utils/src/zone.rs:363
11082025-02-28T23:08:23.463ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc file = illumos-utils/src/zone.rs:363
11092025-02-28T23:08:23.475ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408 file = illumos-utils/src/zone.rs:363
11102025-02-28T23:08:23.483ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b file = illumos-utils/src/zone.rs:363
11112025-02-28T23:08:23.490ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec file = illumos-utils/src/zone.rs:363
11122025-02-28T23:08:23.499ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2 file = illumos-utils/src/zone.rs:363
11132025-02-28T23:08:23.507ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b file = illumos-utils/src/zone.rs:363
11142025-02-28T23:08:23.587ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11152025-02-28T23:08:23.644ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11162025-02-28T23:08:23.703ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11172025-02-28T23:08:23.765ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11182025-02-28T23:08:23.768ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11192025-02-28T23:08:23.768ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11202025-02-28T23:08:23.824ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 181, 43]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11212025-02-28T23:08:23.824ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11222025-02-28T23:08:23.826ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11232025-02-28T23:08:23.826ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11242025-02-28T23:08:23.881ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 150, 53]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11252025-02-28T23:08:23.881ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11262025-02-28T23:08:23.882ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11272025-02-28T23:08:23.882ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11282025-02-28T23:08:23.938ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 205, 42]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11292025-02-28T23:08:23.938ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11302025-02-28T23:08:23.940ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11312025-02-28T23:08:23.940ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11322025-02-28T23:08:23.996ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 215, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11332025-02-28T23:08:23.996ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11342025-02-28T23:08:23.998ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11352025-02-28T23:08:23.998ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11362025-02-28T23:08:24.054ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 138, 9]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11372025-02-28T23:08:24.054ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11382025-02-28T23:08:24.062ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11392025-02-28T23:08:24.062ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11402025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11412025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11422025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11432025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11442025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11452025-02-28T23:08:24.063ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11462025-02-28T23:08:24.065ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11472025-02-28T23:08:24.065ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11482025-02-28T23:08:24.076ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11492025-02-28T23:08:24.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502025-02-28T23:08:24.124ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11512025-02-28T23:08:24.126ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11522025-02-28T23:08:24.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11532025-02-28T23:08:24.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11542025-02-28T23:08:24.130ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11552025-02-28T23:08:24.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562025-02-28T23:08:24.133ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11572025-02-28T23:08:24.302ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11582025-02-28T23:08:24.345ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252 file = illumos-utils/src/zone.rs:325
11592025-02-28T23:08:24.354ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d file = illumos-utils/src/zone.rs:325
11602025-02-28T23:08:24.363ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b file = illumos-utils/src/zone.rs:325
11612025-02-28T23:08:24.371ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 file = illumos-utils/src/zone.rs:325
11622025-02-28T23:08:24.381ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb file = illumos-utils/src/zone.rs:325
11632025-02-28T23:08:24.392ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252 file = illumos-utils/src/zone.rs:363
11642025-02-28T23:08:24.401ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d file = illumos-utils/src/zone.rs:363
11652025-02-28T23:08:24.409ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b file = illumos-utils/src/zone.rs:363
11662025-02-28T23:08:24.417ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 file = illumos-utils/src/zone.rs:363
11672025-02-28T23:08:24.425ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb file = illumos-utils/src/zone.rs:363
11682025-02-28T23:08:34.191ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c1e7df0c-4aac-47ae-a9ef-37e7b6599846'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11692025-02-28T23:08:34.428ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9395a765-3cd5-4500-919f-891f129f4358/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='579c247b-e447-4b06-923b-9a5bc0aa8ce8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702025-02-28T23:08:34.428ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d5534d82-e391-4535-be4a-591aedf1d99f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='222a532f-5507-49f6-ab20-bd5e9a29f327'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712025-02-28T23:08:34.428ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9839a2df-30ff-4ae4-a38c-44deafbd7a59'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11722025-02-28T23:08:34.509ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dd9ff6a5-82c9-4e34-9f3c-664dfbff7a58'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11732025-02-28T23:08:34.548ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11742025-02-28T23:08:34.582ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_17d61349-66a6-4ab5-a1a2-619a947659ed/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='da1cfe44-5e09-4d59-a682-4520ff9f2da4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11752025-02-28T23:08:34.583ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e6859987-fd24-4257-800d-91c0f9f61334/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='228726fe-bdf8-4d5c-a13e-9cf9d518785c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11762025-02-28T23:08:34.619ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11772025-02-28T23:08:34.643ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11782025-02-28T23:08:34.644ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3784060a-c960-42c5-94bf-a6d5afcd1053'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11792025-02-28T23:08:34.645ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='feb1ff0e-4a8f-4b44-8f51-a5b40decc9c0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802025-02-28T23:08:34.645ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
11812025-02-28T23:08:35.009ZINFOSledAgent (ServiceManager): Booting oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
11822025-02-28T23:08:35.015ZINFOSledAgent (ServiceManager): Booting oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
11832025-02-28T23:08:35.076ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842025-02-28T23:08:35.077ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852025-02-28T23:08:35.077ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
11862025-02-28T23:08:35.083ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
11872025-02-28T23:08:35.088ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
11882025-02-28T23:08:35.093ZINFOSledAgent (ServiceManager): Booting oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
11892025-02-28T23:08:35.099ZINFOSledAgent (ServiceManager): Booting oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
11902025-02-28T23:08:35.104ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
11912025-02-28T23:08:35.110ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
11922025-02-28T23:08:35.115ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
11932025-02-28T23:08:35.120ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
11942025-02-28T23:08:35.125ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
11952025-02-28T23:08:35.131ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
11962025-02-28T23:08:36.340ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='14040373-b27e-4ea2-b873-16b58932afec'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972025-02-28T23:08:36.341ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
11982025-02-28T23:08:37.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 38.804851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
11992025-02-28T23:08:37.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 52.530222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
12002025-02-28T23:08:37.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 40.007147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12012025-02-28T23:08:37.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 71.18995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12022025-02-28T23:08:37.893ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 43.050731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12032025-02-28T23:08:37.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 48.022054ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12042025-02-28T23:08:37.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 29.424253ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
12052025-02-28T23:08:37.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 68.353018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
12062025-02-28T23:08:37.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 66.671797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
12072025-02-28T23:08:37.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 47.226518ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
12082025-02-28T23:08:37.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 61.187623ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
12092025-02-28T23:08:37.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 73.361808ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
12102025-02-28T23:08:37.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 32.453073ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12112025-02-28T23:08:37.978ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 33.948483ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12122025-02-28T23:08:37.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 44.219761ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12132025-02-28T23:08:37.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 77.146442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
12142025-02-28T23:08:38.013ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 127.193106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12152025-02-28T23:08:38.027ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 81.665567ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12162025-02-28T23:08:38.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 61.231314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12172025-02-28T23:08:38.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 63.514362ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12182025-02-28T23:08:38.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 145.917324ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
12192025-02-28T23:08:38.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 129.310729ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
12202025-02-28T23:08:38.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 122.316618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
12212025-02-28T23:08:38.149ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 721.033099ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
12222025-02-28T23:08:38.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 112.654495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
12232025-02-28T23:08:38.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 128.021696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
12242025-02-28T23:08:38.193ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 83.369897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
12252025-02-28T23:08:38.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 119.106015ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
12262025-02-28T23:08:38.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 121.760538ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12272025-02-28T23:08:38.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 60.109356ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12282025-02-28T23:08:38.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 91.680832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12292025-02-28T23:08:38.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 146.023704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
12302025-02-28T23:08:38.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 278.289125ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12312025-02-28T23:08:38.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 116.217687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12322025-02-28T23:08:38.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 113.665143ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12332025-02-28T23:08:38.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 246.891524ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12342025-02-28T23:08:38.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 252.886471ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
12352025-02-28T23:08:38.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 218.56868ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
12362025-02-28T23:08:38.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 139.458116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
12372025-02-28T23:08:38.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 262.910596ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
12382025-02-28T23:08:38.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 257.792523ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
12392025-02-28T23:08:38.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 270.281429ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
12402025-02-28T23:08:38.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 121.130721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
12412025-02-28T23:08:38.978ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 264.868422ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12422025-02-28T23:08:39.017ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 227.499017ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12432025-02-28T23:08:39.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 256.794029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12442025-02-28T23:08:39.088ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 539.93024ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
12452025-02-28T23:08:39.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 539.233102ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12462025-02-28T23:08:39.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 477.1859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12472025-02-28T23:08:39.224ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 353.838749ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12482025-02-28T23:08:39.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 364.171379ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12492025-02-28T23:08:39.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 295.164766ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
12502025-02-28T23:08:39.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 558.585846ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
12512025-02-28T23:08:39.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 420.489598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
12522025-02-28T23:08:39.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 200.60316ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
12532025-02-28T23:08:39.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 539.523974ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
12542025-02-28T23:08:39.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 358.285571ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
12552025-02-28T23:08:39.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 246.46508ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
12562025-02-28T23:08:39.398ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 414.0749ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12572025-02-28T23:08:39.409ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 252.022643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12582025-02-28T23:08:39.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 530.51802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12592025-02-28T23:08:39.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.03228005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
12602025-02-28T23:08:39.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 516.170744ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12612025-02-28T23:08:39.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.192735214s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
12622025-02-28T23:08:39.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 869.75344ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
12632025-02-28T23:08:39.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 624.840308ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12642025-02-28T23:08:39.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.181559577s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
12652025-02-28T23:08:39.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 540.415318ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12662025-02-28T23:08:39.711ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 732.744745ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12672025-02-28T23:08:39.723ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 533.631824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12682025-02-28T23:08:39.723ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12692025-02-28T23:08:39.724ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702025-02-28T23:08:39.724ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12712025-02-28T23:08:39.724ZINFOSledAgent (ServiceManager): Booting oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
12722025-02-28T23:08:39.729ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
12732025-02-28T23:08:39.735ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
12742025-02-28T23:08:39.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.088095638s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
12752025-02-28T23:08:39.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.116975174s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
12762025-02-28T23:08:39.836ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 480.667895ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12772025-02-28T23:08:39.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 799.374032ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
12782025-02-28T23:08:39.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.159618396s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
12792025-02-28T23:08:39.953ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 39.738315ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
12802025-02-28T23:08:39.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 56.959025ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
12812025-02-28T23:08:39.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 544.673007ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12822025-02-28T23:08:39.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 68.491001ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
12832025-02-28T23:08:40.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 132.852011ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
12842025-02-28T23:08:40.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 134.106667ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
12852025-02-28T23:08:40.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 98.78467ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
12862025-02-28T23:08:40.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 685.671616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
12872025-02-28T23:08:40.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 194.582611ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
12882025-02-28T23:08:40.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 111.246364ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
12892025-02-28T23:08:40.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 248.421694ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
12902025-02-28T23:08:40.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.224962756s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
12912025-02-28T23:08:40.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.276708239s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
12922025-02-28T23:08:40.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 364.912789ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
12932025-02-28T23:08:40.317ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.416011653s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
12942025-02-28T23:08:40.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 640.65799ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
12952025-02-28T23:08:40.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 486.744886ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
12962025-02-28T23:08:40.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 487.532993ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
12972025-02-28T23:08:40.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 629.475842ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
12982025-02-28T23:08:40.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.466061021s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
12992025-02-28T23:08:40.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.208694399s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
13002025-02-28T23:08:40.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.374641082s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13012025-02-28T23:08:40.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 761.506497ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
13022025-02-28T23:08:40.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 765.220245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13032025-02-28T23:08:40.824ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.131642314s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
13042025-02-28T23:08:40.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.178965182s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
13052025-02-28T23:08:40.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 702.877189ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
13062025-02-28T23:08:40.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.468099763s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
13072025-02-28T23:08:40.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.495545962s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
13082025-02-28T23:08:40.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.083649799s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13092025-02-28T23:08:40.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 578.084687ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13102025-02-28T23:08:40.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.306802057s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
13112025-02-28T23:08:41.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 625.43012ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
13122025-02-28T23:08:41.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 1.137620059s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
13132025-02-28T23:08:41.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.082774048s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
13142025-02-28T23:08:41.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 885.716929ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13152025-02-28T23:08:41.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 828.360917ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13162025-02-28T23:08:41.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 575.337354ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13172025-02-28T23:08:41.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.420725114s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
13182025-02-28T23:08:41.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 845.700971ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
13192025-02-28T23:08:41.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.041628541s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
13202025-02-28T23:08:41.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.067219843s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
13212025-02-28T23:08:41.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.156401737s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
13222025-02-28T23:08:41.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 656.375993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
13232025-02-28T23:08:41.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 721.534598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13242025-02-28T23:08:41.993ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 605.054565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13252025-02-28T23:08:42.007ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.045755249s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
13262025-02-28T23:08:42.035ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 672.949821ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
13272025-02-28T23:08:42.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 617.505725ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13282025-02-28T23:08:42.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 710.535908ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
13292025-02-28T23:08:42.326ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.214654787s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
13302025-02-28T23:08:42.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 579.344144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13312025-02-28T23:08:42.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 897.69547ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
13322025-02-28T23:08:42.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 723.601191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13332025-02-28T23:08:42.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.354424227s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
13342025-02-28T23:08:42.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.365072361s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
13352025-02-28T23:08:42.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.032469906s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
13362025-02-28T23:08:42.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 596.823279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13372025-02-28T23:08:42.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.279033034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
13382025-02-28T23:08:42.713ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 743.523328ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13392025-02-28T23:08:42.721ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.286445778s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
13402025-02-28T23:08:42.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 644.992156ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13412025-02-28T23:08:42.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.301784594s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
13422025-02-28T23:08:42.818ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 524.957983ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
13432025-02-28T23:08:42.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 727.384076ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13442025-02-28T23:08:42.939ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.355250876s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
13452025-02-28T23:08:42.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 1.303749098s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
13462025-02-28T23:08:42.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.161125126s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
13472025-02-28T23:08:43.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 645.374111ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
13482025-02-28T23:08:43.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.204298571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13492025-02-28T23:08:43.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 938.134725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13502025-02-28T23:08:43.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 821.62186ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
13512025-02-28T23:08:43.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.357076076s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
13522025-02-28T23:08:43.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 940.881035ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13532025-02-28T23:08:43.466ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 866.876534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13542025-02-28T23:08:43.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 890.070371ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
13552025-02-28T23:08:43.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.095495638s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
13562025-02-28T23:08:43.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 769.393715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13572025-02-28T23:08:43.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 844.4537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
13582025-02-28T23:08:43.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 883.882668ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
13592025-02-28T23:08:43.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 753.054602ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
13602025-02-28T23:08:43.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.166743219s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
13612025-02-28T23:08:44.017ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.456191753s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
13622025-02-28T23:08:44.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 972.053563ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
13632025-02-28T23:08:44.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.411730562s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
13642025-02-28T23:08:44.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.282902673s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
13652025-02-28T23:08:44.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 592.588661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13662025-02-28T23:08:44.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 918.313904ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
13672025-02-28T23:08:44.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.208946542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
13682025-02-28T23:08:44.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.094980027s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13692025-02-28T23:08:44.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 581.094097ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13702025-02-28T23:08:44.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.241798359s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13712025-02-28T23:08:44.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 641.039803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13722025-02-28T23:08:44.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.228761501s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
13732025-02-28T23:08:44.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.172503775s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
13742025-02-28T23:08:44.575ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.385592831s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
13752025-02-28T23:08:44.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.491168912s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
13762025-02-28T23:08:44.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.107024438s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
13772025-02-28T23:08:44.723ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 677.625976ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
13782025-02-28T23:08:44.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 541.672475ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13792025-02-28T23:08:44.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 808.970044ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13802025-02-28T23:08:45.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 716.52105ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
13812025-02-28T23:08:45.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.313009608s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
13822025-02-28T23:08:45.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 876.570792ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
13832025-02-28T23:08:45.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 1.025043363s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
13842025-02-28T23:08:45.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 992.587731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
13852025-02-28T23:08:45.400ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862025-02-28T23:08:45.401ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
13872025-02-28T23:08:45.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 584.498766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
13882025-02-28T23:08:45.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 716.372155ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
13892025-02-28T23:08:45.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.137053415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
13902025-02-28T23:08:45.485ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.233906416s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
13912025-02-28T23:08:45.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.381095503s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
13922025-02-28T23:08:45.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.473639726s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
13932025-02-28T23:08:45.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 40.18568ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
13942025-02-28T23:08:45.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.419906126s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
13952025-02-28T23:08:45.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 59.839999ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
13962025-02-28T23:08:45.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.202798021s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
13972025-02-28T23:08:45.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 283.937773ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
13982025-02-28T23:08:45.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.064590113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
13992025-02-28T23:08:45.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.216726904s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
14002025-02-28T23:08:45.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 846.630162ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14012025-02-28T23:08:45.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.318357303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
14022025-02-28T23:08:45.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 949.962969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
14032025-02-28T23:08:46.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 691.486777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
14042025-02-28T23:08:46.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.061695065s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14052025-02-28T23:08:46.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 593.107781ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14062025-02-28T23:08:46.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.195957251s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
14072025-02-28T23:08:46.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 535.441033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14082025-02-28T23:08:46.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 610.274795ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14092025-02-28T23:08:46.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.315622895s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
14102025-02-28T23:08:46.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 585.734924ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14112025-02-28T23:08:46.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 509.812665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14122025-02-28T23:08:46.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 969.826938ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14132025-02-28T23:08:46.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.400445591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14142025-02-28T23:08:46.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.426661823s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
14152025-02-28T23:08:46.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 917.274732ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14162025-02-28T23:08:46.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 637.741959ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
14172025-02-28T23:08:46.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 621.407129ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14182025-02-28T23:08:46.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 969.434782ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
14192025-02-28T23:08:46.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 703.109708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
14202025-02-28T23:08:46.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.485831528s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
14212025-02-28T23:08:46.957ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 675.00628ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
14222025-02-28T23:08:47.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 900.141436ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
14232025-02-28T23:08:47.039ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 682.14189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14242025-02-28T23:08:47.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 595.827865ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
14252025-02-28T23:08:47.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.102341915s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
14262025-02-28T23:08:47.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 606.187806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14272025-02-28T23:08:47.154ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 829.1325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14282025-02-28T23:08:47.205ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.484707707s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
14292025-02-28T23:08:47.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.363299646s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
14302025-02-28T23:08:47.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 500.496862ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
14312025-02-28T23:08:47.519ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 664.343201ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14322025-02-28T23:08:47.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.495367313s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
14332025-02-28T23:08:47.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.343565592s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
14342025-02-28T23:08:47.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 560.190264ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14352025-02-28T23:08:47.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.007681411s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
14362025-02-28T23:08:47.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 540.35768ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
14372025-02-28T23:08:47.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.240183822s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14382025-02-28T23:08:47.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 562.392038ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14392025-02-28T23:08:47.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 573.394475ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14402025-02-28T23:08:47.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 715.697873ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
14412025-02-28T23:08:47.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.159422454s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
14422025-02-28T23:08:47.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.03486809s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
14432025-02-28T23:08:47.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 714.315299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14442025-02-28T23:08:48.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 594.75418ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14452025-02-28T23:08:48.171ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.018458033s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
14462025-02-28T23:08:48.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 856.227419ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14472025-02-28T23:08:48.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.012545142s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
14482025-02-28T23:08:48.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 604.588987ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14492025-02-28T23:08:48.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.419925227s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
14502025-02-28T23:08:48.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 962.554836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14512025-02-28T23:08:48.326ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.30575934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14522025-02-28T23:08:48.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 630.016933ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
14532025-02-28T23:08:48.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.17650862s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
14542025-02-28T23:08:48.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.24838485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
14552025-02-28T23:08:48.703ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 612.650804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
14562025-02-28T23:08:48.721ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.102634083s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14572025-02-28T23:08:48.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 912.834041ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14582025-02-28T23:08:48.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.113304542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
14592025-02-28T23:08:48.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 998.231287ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14602025-02-28T23:08:48.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 644.896979ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14612025-02-28T23:08:48.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.096831581s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
14622025-02-28T23:08:49.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.082047706s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
14632025-02-28T23:08:49.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 509.908577ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14642025-02-28T23:08:49.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.330284421s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
14652025-02-28T23:08:49.102ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 602.485502ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
14662025-02-28T23:08:49.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 579.086804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
14672025-02-28T23:08:49.205ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.441363875s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
14682025-02-28T23:08:49.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.087981802s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
14692025-02-28T23:08:49.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 929.841548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14702025-02-28T23:08:49.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.182712989s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
14712025-02-28T23:08:49.598ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 754.398478ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14722025-02-28T23:08:49.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.167331575s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14732025-02-28T23:08:49.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.07021854s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14742025-02-28T23:08:49.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.088487475s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14752025-02-28T23:08:49.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.225078271s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
14762025-02-28T23:08:49.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.457234308s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
14772025-02-28T23:08:49.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.280118846s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
14782025-02-28T23:08:49.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.367585618s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
14792025-02-28T23:08:49.836ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 858.113423ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14802025-02-28T23:08:49.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 1.467186511s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
14812025-02-28T23:08:49.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 863.766387ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
14822025-02-28T23:08:49.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 975.084503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
14832025-02-28T23:08:50.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.313423959s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
14842025-02-28T23:08:50.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.018587993s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
14852025-02-28T23:08:50.225ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 502.746415ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14862025-02-28T23:08:50.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 716.374997ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
14872025-02-28T23:08:50.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 713.244285ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
14882025-02-28T23:08:50.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 978.028708ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
14892025-02-28T23:08:50.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 583.305895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
14902025-02-28T23:08:50.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 715.070743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
14912025-02-28T23:08:50.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.036210376s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
14922025-02-28T23:08:50.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.021079479s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
14932025-02-28T23:08:50.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.087411239s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
14942025-02-28T23:08:50.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 832.54505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
14952025-02-28T23:08:50.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 637.625024ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
14962025-02-28T23:08:50.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 525.811298ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
14972025-02-28T23:08:50.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 753.857049ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
14982025-02-28T23:08:50.943ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.306782085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
14992025-02-28T23:08:51.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 643.924106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15002025-02-28T23:08:51.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.147121612s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
15012025-02-28T23:08:51.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 611.569781ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15022025-02-28T23:08:51.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 887.589826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
15032025-02-28T23:08:51.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 749.454903ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15042025-02-28T23:08:51.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 684.744915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
15052025-02-28T23:08:51.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 865.511032ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
15062025-02-28T23:08:51.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.330909804s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
15072025-02-28T23:08:51.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 1.297646077s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
15082025-02-28T23:08:51.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 1.070918184s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15092025-02-28T23:08:51.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.314633328s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
15102025-02-28T23:08:51.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.433593411s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
15112025-02-28T23:08:51.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 671.873158ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
15122025-02-28T23:08:51.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 960.968191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15132025-02-28T23:08:51.676ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 684.387004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15142025-02-28T23:08:51.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.476115441s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
15152025-02-28T23:08:51.711ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 1.18550396s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15162025-02-28T23:08:51.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 821.695013ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
15172025-02-28T23:08:51.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.139001225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
15182025-02-28T23:08:51.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.295980971s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
15192025-02-28T23:08:51.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 710.856455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
15202025-02-28T23:08:51.896ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.233469398s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15212025-02-28T23:08:52.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.281322611s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
15222025-02-28T23:08:52.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 927.209121ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
15232025-02-28T23:08:52.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.392926044s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
15242025-02-28T23:08:52.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 893.410063ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
15252025-02-28T23:08:52.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 897.511438ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
15262025-02-28T23:08:52.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 642.382721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15272025-02-28T23:08:52.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 510.337725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15282025-02-28T23:08:52.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 664.15794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15292025-02-28T23:08:52.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.444805755s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
15302025-02-28T23:08:52.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 1.436598225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
15312025-02-28T23:08:52.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 807.298462ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
15322025-02-28T23:08:52.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.299820212s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
15332025-02-28T23:08:52.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40583
15342025-02-28T23:08:52.739ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35461 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40583 req_id = bac4336f-9545-427b-8d22-f1299c7b92d6 response_code = 200 uri = /baseboard
15352025-02-28T23:08:52.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 772.824888ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
15362025-02-28T23:08:52.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 677.492181ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
15372025-02-28T23:08:52.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 511.429119ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15382025-02-28T23:08:52.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 501.787641ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
15392025-02-28T23:08:52.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 972.634305ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15402025-02-28T23:08:52.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 962.966192ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
15412025-02-28T23:08:53.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.334014473s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15422025-02-28T23:08:53.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 582.72149ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
15432025-02-28T23:08:53.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 718.902324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15442025-02-28T23:08:53.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 525.011393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
15452025-02-28T23:08:53.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 823.895897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
15462025-02-28T23:08:53.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 594.476813ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
15472025-02-28T23:08:53.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 607.685725ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15482025-02-28T23:08:53.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 795.998016ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
15492025-02-28T23:08:53.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 849.335241ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15502025-02-28T23:08:53.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 1.24937331s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
15512025-02-28T23:08:53.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 1.001356078s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
15522025-02-28T23:08:53.516ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 716.173822ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
15532025-02-28T23:08:53.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.470879146s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
15542025-02-28T23:08:53.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 1.365100639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
15552025-02-28T23:08:53.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 834.233706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
15562025-02-28T23:08:53.720ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.418427496s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
15572025-02-28T23:08:53.777ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 732.086694ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
15582025-02-28T23:08:53.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.02666963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15592025-02-28T23:08:53.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 722.101621ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15602025-02-28T23:08:53.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 1.195641304s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
15612025-02-28T23:08:53.976ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 695.6306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15622025-02-28T23:08:53.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.097028797s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
15632025-02-28T23:08:53.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 710.489831ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
15642025-02-28T23:08:54.038ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 976.644126ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
15652025-02-28T23:08:54.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2") failed: Property not found. retry in 729.387393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
15662025-02-28T23:08:54.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 743.396235ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
15672025-02-28T23:08:54.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 632.094131ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
15682025-02-28T23:08:54.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 852.810126ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15692025-02-28T23:08:54.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.112466958s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15702025-02-28T23:08:54.388ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.009900015s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
15712025-02-28T23:08:54.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 1.018827697s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
15722025-02-28T23:08:54.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 875.457374ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
15732025-02-28T23:08:54.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2") failed: Property not found. retry in 1.474105405s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
15742025-02-28T23:08:54.598ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 823.818596ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15752025-02-28T23:08:54.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 773.819196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15762025-02-28T23:08:54.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 641.183218ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
15772025-02-28T23:08:54.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 1.144438415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
15782025-02-28T23:08:54.881ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc") failed: Property not found. retry in 1.209644374s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
15792025-02-28T23:08:54.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec") failed: Property not found. retry in 1.144407275s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
15802025-02-28T23:08:54.897ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 758.988779ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15812025-02-28T23:08:54.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 585.353314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
15822025-02-28T23:08:55.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c") failed: Property not found. retry in 1.018059157s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
15832025-02-28T23:08:55.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.075558622s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
15842025-02-28T23:08:55.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252") failed: Property not found. retry in 1.146307856s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
15852025-02-28T23:08:55.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb") failed: Property not found. retry in 1.4102142s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
15862025-02-28T23:08:55.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b") failed: Property not found. retry in 1.144555461s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
15872025-02-28T23:08:55.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d") failed: Property not found. retry in 915.726425ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
15882025-02-28T23:08:55.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2") failed: Property not found. retry in 827.186556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
15892025-02-28T23:08:55.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2") failed: Property not found. retry in 1.438864726s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
15902025-02-28T23:08:55.450ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b") failed: Property not found. retry in 1.296833231s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
15912025-02-28T23:08:55.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a") failed: Property not found. retry in 857.343642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
15922025-02-28T23:08:55.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408") failed: Property not found. retry in 1.476776885s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
15932025-02-28T23:08:55.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415") failed: Property not found. retry in 1.401085232s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
15942025-02-28T23:08:55.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b") failed: Property not found. retry in 818.807225ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
15952025-02-28T23:08:55.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f") failed: Property not found. retry in 1.239126833s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15962025-02-28T23:08:55.873ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19") failed: Property not found. retry in 924.35185ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
15972025-02-28T23:08:56.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08") failed: Property not found. retry in 1.324735613s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
15982025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_ae10da9e-d02f-4c25-925c-6b3256cfed7f
15992025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_c58a709c-6408-4add-a379-1443327e0f08
16002025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_93200bf6-e9f2-485e-8e7d-bd7075ff8cc2
16012025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_de3be315-72e8-4256-af1b-17017cdd9a8a
16022025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb
16032025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_b76b0ba8-47ba-4bfc-8a97-b369297e1415
16042025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_431cd3aa-3cd0-477f-978b-e37653464252
16052025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_b0e3cb3e-c072-4223-920e-1364ded6c14d
16062025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_1b513750-0007-4ce9-b36a-deb831551c9c
16072025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_7a11c084-2890-4137-9a8e-e027a350cf19
16082025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_27ccf5d2-b51e-473e-8c99-6d654e6576b2
16092025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_398ab3fa-658b-4d3e-9c99-f5715ac4e4dc
16102025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_52ad7911-a790-442e-97d6-87d129f12408
16112025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b
16122025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2
16132025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_4ea9a82e-2bb1-465c-b67c-e820ca18a36b
16142025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_14040373-b27e-4ea2-b873-16b58932afec
16152025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_5dc1f9d7-3c9e-4564-b429-d9aa2729e1b2
16162025-02-28T23:08:57.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_a3b92681-ed11-475b-b75d-7d992dc3612b
16172025-02-28T23:08:57.552ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16182025-02-28T23:08:57.564ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16192025-02-28T23:08:57.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35073087 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33554 req_id = eeacf701-6570-4594-948e-2941af8e5138 response_code = 204 uri = /omicron-zones
16202025-02-28T23:08:57.590ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
16212025-02-28T23:08:57.967ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16222025-02-28T23:08:57.981ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
16232025-02-28T23:08:58.036ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
16242025-02-28T23:09:03.547ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.302854975s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
16252025-02-28T23:09:05.958ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16262025-02-28T23:09:06.086ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16272025-02-28T23:09:06.255ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16282025-02-28T23:09:06.440ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16292025-02-28T23:09:06.679ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16302025-02-28T23:09:06.924ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16312025-02-28T23:09:07.251ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16322025-02-28T23:09:07.639ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16332025-02-28T23:09:07.886ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.029521496s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
16342025-02-28T23:09:08.097ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4848917-f3dd-4b83-ac2a-514cdf0c5803/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16352025-02-28T23:09:10.124ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c191be7b-7578-409c-aedb-18011200096c", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4848917-f3dd-4b83-ac2a-514cdf0c5803\"", request_id: "c191be7b-7578-409c-aedb-18011200096c" } file = sled-agent/src/rack_setup/service.rs:1065
16362025-02-28T23:09:10.819ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "facbce76-5948-4c1b-9bc5-a64964003e8a", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4848917-f3dd-4b83-ac2a-514cdf0c5803\"", request_id: "facbce76-5948-4c1b-9bc5-a64964003e8a" } file = sled-agent/src/rack_setup/service.rs:1065
16372025-02-28T23:09:11.568ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3eb096e0-5b2b-4557-9a13-e43ab50d41dc", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4848917-f3dd-4b83-ac2a-514cdf0c5803\"", request_id: "3eb096e0-5b2b-4557-9a13-e43ab50d41dc" } file = sled-agent/src/rack_setup/service.rs:1065
16382025-02-28T23:09:12.005ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "12f65f70-0fa4-42a3-9811-c2c0ca49738e", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4848917-f3dd-4b83-ac2a-514cdf0c5803\"", request_id: "12f65f70-0fa4-42a3-9811-c2c0ca49738e" } file = sled-agent/src/rack_setup/service.rs:1065
16392025-02-28T23:09:14.755ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "96afbd3b-133d-4d5a-934e-bff31241ab32", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "96afbd3b-133d-4d5a-934e-bff31241ab32" } file = sled-agent/src/rack_setup/service.rs:1065
16402025-02-28T23:09:16.178ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ac90de3b-3e78-451e-9300-810ff50d002b", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "ac90de3b-3e78-451e-9300-810ff50d002b" } file = sled-agent/src/rack_setup/service.rs:1065
16412025-02-28T23:09:18.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c555253c-c0f6-4abb-be9b-f7a96859694c", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "c555253c-c0f6-4abb-be9b-f7a96859694c" } file = sled-agent/src/rack_setup/service.rs:1065
16422025-02-28T23:09:19.551ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a7cd3b85-1f7f-4476-95b3-14a0c25b9e8a", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "a7cd3b85-1f7f-4476-95b3-14a0c25b9e8a" } file = sled-agent/src/rack_setup/service.rs:1065
16432025-02-28T23:09:21.777ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "343cf9a0-048e-4864-919c-d32507c2d5cc", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "343cf9a0-048e-4864-919c-d32507c2d5cc" } file = sled-agent/src/rack_setup/service.rs:1065
16442025-02-28T23:09:22.791ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55866
16452025-02-28T23:09:22.792ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55866 req_id = 6a211f08-6c5b-4d68-9c32-1e6b71522ec1 response_code = 200 uri = /baseboard
16462025-02-28T23:09:25.287ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e5153c0-f1d2-4784-a060-9826d3fd114a", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "7e5153c0-f1d2-4784-a060-9826d3fd114a" } file = sled-agent/src/rack_setup/service.rs:1065
16472025-02-28T23:09:27.479ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6c09cc62-0aa8-4ab0-bcf5-ce3cff122036", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "6c09cc62-0aa8-4ab0-bcf5-ce3cff122036" } file = sled-agent/src/rack_setup/service.rs:1065
16482025-02-28T23:09:32.389ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5e9fa692-f3ce-4417-b4a7-46eec29f7cf0", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "5e9fa692-f3ce-4417-b4a7-46eec29f7cf0" } file = sled-agent/src/rack_setup/service.rs:1065
16492025-02-28T23:09:36.018ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b662f102-7b36-4387-944c-0295eb198f2a", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "b662f102-7b36-4387-944c-0295eb198f2a" } file = sled-agent/src/rack_setup/service.rs:1065
16502025-02-28T23:09:39.044ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cd8d9c5b-8087-4b2d-be2e-63ba0c2d7662", "content-length": "173", "date": "Fri, 28 Feb 2025 23:09:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"eb977560-79bb-4094-9f3c-0c8f67caef5b\"", request_id: "cd8d9c5b-8087-4b2d-be2e-63ba0c2d7662" } file = sled-agent/src/rack_setup/service.rs:1065
16512025-02-28T23:09:45.873ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
16522025-02-28T23:09:45.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58283
16532025-02-28T23:09:45.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16542025-02-28T23:09:45.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16552025-02-28T23:09:45.965ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
16562025-02-28T23:09:45.968ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
16572025-02-28T23:09:45.983ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16582025-02-28T23:09:45.984ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e6859987-fd24-4257-800d-91c0f9f61334
16592025-02-28T23:09:46.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16602025-02-28T23:09:46.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402
16612025-02-28T23:09:46.031ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16622025-02-28T23:09:46.031ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e
16632025-02-28T23:09:46.055ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16642025-02-28T23:09:46.055ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3
16652025-02-28T23:09:46.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16662025-02-28T23:09:46.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f
16672025-02-28T23:09:46.098ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16682025-02-28T23:09:46.098ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17d61349-66a6-4ab5-a1a2-619a947659ed
16692025-02-28T23:09:46.119ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16702025-02-28T23:09:46.119ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97
16712025-02-28T23:09:46.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16722025-02-28T23:09:46.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9395a765-3cd5-4500-919f-891f129f4358
16732025-02-28T23:09:46.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16742025-02-28T23:09:46.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d5534d82-e391-4535-be4a-591aedf1d99f
16752025-02-28T23:09:46.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214872 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58283 req_id = 713c8b71-61b0-48c8-99d8-3b5e5cd9d6e7 response_code = 200 uri = /inventory
16762025-02-28T23:09:46.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47301
16772025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16782025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16792025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16802025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16812025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16822025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16832025-02-28T23:09:46.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16842025-02-28T23:09:46.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47301 req_id = be10d2e6-b633-4430-888d-02646e45d75d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16852025-02-28T23:09:46.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54727
16862025-02-28T23:09:46.930ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
16872025-02-28T23:09:46.933ZINFOSledAgent (RSS): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16882025-02-28T23:09:46.933ZINFOSledAgent (RSS): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16892025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16902025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16922025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16932025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
16942025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952025-02-28T23:09:46.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16962025-02-28T23:09:46.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54727 req_id = e809b59b-c57c-448e-ab90-058d638995b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16972025-02-28T23:09:47.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39766
16982025-02-28T23:09:47.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16992025-02-28T23:09:47.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17002025-02-28T23:09:47.219ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
17012025-02-28T23:09:47.219ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
17022025-02-28T23:09:47.231ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17032025-02-28T23:09:47.231ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e6859987-fd24-4257-800d-91c0f9f61334
17042025-02-28T23:09:47.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17052025-02-28T23:09:47.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402
17062025-02-28T23:09:47.272ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17072025-02-28T23:09:47.272ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e
17082025-02-28T23:09:47.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17092025-02-28T23:09:47.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3
17102025-02-28T23:09:47.314ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17112025-02-28T23:09:47.314ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f
17122025-02-28T23:09:47.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17132025-02-28T23:09:47.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17d61349-66a6-4ab5-a1a2-619a947659ed
17142025-02-28T23:09:47.359ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17152025-02-28T23:09:47.359ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97
17162025-02-28T23:09:47.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17172025-02-28T23:09:47.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9395a765-3cd5-4500-919f-891f129f4358
17182025-02-28T23:09:47.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17192025-02-28T23:09:47.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d5534d82-e391-4535-be4a-591aedf1d99f
17202025-02-28T23:09:47.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39766 req_id = 37294c0a-b1d5-41f1-83df-2a03632c87cd response_code = 200 uri = /inventory
17212025-02-28T23:09:48.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61511
17222025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17232025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17242025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17252025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17272025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282025-02-28T23:09:48.056ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17292025-02-28T23:09:48.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61511 req_id = 8515590d-f177-4542-95b4-b84bba2082cc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17302025-02-28T23:09:48.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61015
17312025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17322025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17332025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17342025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17362025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372025-02-28T23:09:48.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17382025-02-28T23:09:48.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61015 req_id = b96fd59c-0b45-4747-af27-0b9175598afc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17392025-02-28T23:09:52.840ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51292
17402025-02-28T23:09:52.840ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51292 req_id = a1369879-a67f-4223-8b3b-7eabd008f84f response_code = 200 uri = /baseboard
17412025-02-28T23:09:53.274ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:54102 remote_addr = [fd00:1122:3344:101::d]:59901 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
17422025-02-28T23:09:53.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36530 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 25b9f638-e7aa-4221-b0af-88297d693fb1 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
17432025-02-28T23:09:55.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62673
17442025-02-28T23:09:55.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62673 req_id = d98a56f4-93f6-4063-a1cb-b6e854de6c62 response_code = 200 uri = /vpc-routes
17452025-02-28T23:09:55.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
17462025-02-28T23:09:55.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62673 req_id = 72bfb5a2-7a44-49b9-b60f-20ca691b9676 response_code = 204 uri = /eip-gateways
17472025-02-28T23:09:55.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1690 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62673 req_id = 8d0d21be-a087-4863-bd0b-f38a1218406a response_code = 204 uri = /vpc-routes
17482025-02-28T23:10:12.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42824
17492025-02-28T23:10:12.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42824 req_id = 4090ea7b-a53c-41dc-be8d-72dbfe931357 response_code = 200 uri = /vpc-routes
17502025-02-28T23:10:12.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54789
17512025-02-28T23:10:12.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54789 req_id = cab6793c-efd8-4af9-ab64-ee7b3309562a response_code = 200 uri = /vpc-routes
17522025-02-28T23:10:12.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
17532025-02-28T23:10:12.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42824 req_id = ad104da3-9cd5-4a5d-acd3-2e4854384575 response_code = 204 uri = /eip-gateways
17542025-02-28T23:10:12.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
17552025-02-28T23:10:12.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54789 req_id = d9f95a56-ecbb-4eee-8537-b007b3e79212 response_code = 204 uri = /eip-gateways
17562025-02-28T23:10:12.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54789 req_id = 9880ac7b-cf90-4c1f-8bd5-f065b70fa230 response_code = 204 uri = /vpc-routes
17572025-02-28T23:10:12.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63587
17582025-02-28T23:10:12.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63587 req_id = caec3c3f-0427-4615-a6b7-0aeacc822d02 response_code = 200 uri = /v2p
17592025-02-28T23:10:13.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36610
17602025-02-28T23:10:13.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36610 req_id = fc2d363c-8987-4cc0-8028-a8ef91f78d8c response_code = 200 uri = /v2p
17612025-02-28T23:10:13.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42824 req_id = 915898d0-cbd9-462b-87b9-8ecc39ddcd23 response_code = 204 uri = /vpc-routes
17622025-02-28T23:10:13.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57473
17632025-02-28T23:10:13.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57473 req_id = c0c2287d-ba93-4dc9-9465-01a3f66e370a response_code = 200 uri = /vpc-routes
17642025-02-28T23:10:13.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
17652025-02-28T23:10:13.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57473 req_id = 0f46261c-dfd6-4c59-be2a-0ad0877e4fad response_code = 204 uri = /eip-gateways
17662025-02-28T23:10:13.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57827
17672025-02-28T23:10:13.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17682025-02-28T23:10:13.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17692025-02-28T23:10:13.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57827 req_id = 0a18151b-e6b5-4dcd-a3b1-ace4d46e5701 response_code = 204 uri = /switch-ports
17702025-02-28T23:10:13.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54538
17712025-02-28T23:10:13.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64979
17722025-02-28T23:10:13.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47166
17732025-02-28T23:10:13.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57473 req_id = f882dc0a-5fc7-47dd-9268-87bf0c66bf70 response_code = 204 uri = /vpc-routes
17742025-02-28T23:10:13.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17752025-02-28T23:10:13.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54538 req_id = b618cd89-f11b-4264-acfe-a6e45a1b088f response_code = 200 uri = /v2p
17762025-02-28T23:10:13.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57827 req_id = 3be81c70-941b-43ab-abdb-2a4f34cddf4c response_code = 200 uri = /network-bootstore-config
17772025-02-28T23:10:13.352ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17782025-02-28T23:10:13.352ZINFOSledAgent (bootstore): Writing ledger to /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17792025-02-28T23:10:13.353ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17802025-02-28T23:10:13.355ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17812025-02-28T23:10:13.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3643 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57827 req_id = c85a3db1-4b56-4b3a-9672-8e18516dd794 response_code = 204 uri = /network-bootstore-config
17822025-02-28T23:10:13.360ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17832025-02-28T23:10:13.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17842025-02-28T23:10:13.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64979 req_id = fcf57a9f-8c64-4903-94b4-5def7d21533a response_code = 204 uri = /switch-ports
17852025-02-28T23:10:13.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 678 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64979 req_id = f71a8522-b693-4f50-9149-fb739ab57640 response_code = 200 uri = /network-bootstore-config
17862025-02-28T23:10:13.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17872025-02-28T23:10:13.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47166 req_id = 2a0bb208-cf6f-473c-a252-d80ead8fd6be response_code = 204 uri = /switch-ports
17882025-02-28T23:10:13.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47166 req_id = 6f132dec-7938-412f-8d85-8065ffb31c5a response_code = 200 uri = /network-bootstore-config
17892025-02-28T23:10:22.876ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41434
17902025-02-28T23:10:22.877ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41434 req_id = c407f7eb-84fb-441f-93f6-1ac429b51d15 response_code = 200 uri = /baseboard
17912025-02-28T23:10:23.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7549 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 370e7d29-61dc-4ea2-8921-3b5f8e53fcec response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
17922025-02-28T23:10:42.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46089
17932025-02-28T23:10:42.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46089 req_id = 01fde046-bf2d-465b-a172-d242e8fd5542 response_code = 200 uri = /vpc-routes
17942025-02-28T23:10:42.573ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
17952025-02-28T23:10:42.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46089 req_id = d9c8c4fd-8574-469d-bdd4-9ef34eaa33a5 response_code = 204 uri = /eip-gateways
17962025-02-28T23:10:42.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46089 req_id = 85eb6ee0-52f6-4013-95de-18caf8272af6 response_code = 204 uri = /vpc-routes
17972025-02-28T23:10:42.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63100
17982025-02-28T23:10:42.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63100 req_id = b81bdab5-56f2-4e0e-af22-27fd6ca5dc59 response_code = 200 uri = /vpc-routes
17992025-02-28T23:10:42.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65324
18002025-02-28T23:10:42.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18012025-02-28T23:10:42.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18022025-02-28T23:10:42.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65324 req_id = 361cecab-6f2d-43e5-b909-b730ae80b0c5 response_code = 204 uri = /switch-ports
18032025-02-28T23:10:42.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43337
18042025-02-28T23:10:42.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43337 req_id = 6af82ce7-4d53-4df6-81b8-4d88484a571a response_code = 200 uri = /v2p
18052025-02-28T23:10:42.751ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18062025-02-28T23:10:42.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65324 req_id = 62dfaa5b-d5d6-4d13-af45-82427c108e51 response_code = 200 uri = /network-bootstore-config
18072025-02-28T23:10:42.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63100 req_id = c85a2b7f-65eb-4f73-9ef7-ab243242ab13 response_code = 204 uri = /eip-gateways
18082025-02-28T23:10:42.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63100 req_id = 2c6df234-0710-40b6-9e9e-ae1f8010647f response_code = 204 uri = /vpc-routes
18092025-02-28T23:10:42.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56953
18102025-02-28T23:10:42.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18112025-02-28T23:10:42.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18122025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56953 req_id = 4fd984cb-b20b-4170-9f73-64263a90f4c8 response_code = 204 uri = /switch-ports
18132025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41805
18142025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34000
18152025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56953 req_id = b9a02d8b-6a39-4ae9-ace1-0209248d1de6 response_code = 200 uri = /network-bootstore-config
18162025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34000 req_id = 857c0f87-2a43-4d89-8a75-24a59d15ce9f response_code = 200 uri = /vpc-routes
18172025-02-28T23:10:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41805 req_id = c0b4279b-a31e-439b-9a95-ac09d76daddb response_code = 200 uri = /v2p
18182025-02-28T23:10:42.922ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18192025-02-28T23:10:42.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34000 req_id = b0f56450-c4f8-41f3-b649-8e726fcee477 response_code = 204 uri = /eip-gateways
18202025-02-28T23:10:42.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34000 req_id = 28b43be3-8d17-489e-a23f-8911c453187a response_code = 204 uri = /vpc-routes
18212025-02-28T23:10:42.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40418
18222025-02-28T23:10:42.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40418 req_id = b791fec3-2eba-4817-9bfa-604ca70b6986 response_code = 200 uri = /v2p
18232025-02-28T23:10:43.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55526
18242025-02-28T23:10:43.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18252025-02-28T23:10:43.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18262025-02-28T23:10:43.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55526 req_id = c8bbdf98-0307-4726-8fe5-8756edd21d96 response_code = 204 uri = /switch-ports
18272025-02-28T23:10:43.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55526 req_id = f573318d-986a-47c7-8752-ebbefdac71d9 response_code = 200 uri = /network-bootstore-config
18282025-02-28T23:10:52.908ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58456
18292025-02-28T23:10:52.909ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58456 req_id = 5fe2ed90-9f45-4b3a-8417-c8327b02d126 response_code = 200 uri = /baseboard
18302025-02-28T23:10:53.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7027 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = ba17e6a3-6054-4894-8f34-730a02d2233e response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
18312025-02-28T23:11:12.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43421
18322025-02-28T23:11:12.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43421 req_id = 2155b874-3aad-4f88-86de-7f333c4e479f response_code = 200 uri = /vpc-routes
18332025-02-28T23:11:12.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18342025-02-28T23:11:12.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43421 req_id = 50933feb-1345-4a7a-b8dc-0704870c28a9 response_code = 204 uri = /eip-gateways
18352025-02-28T23:11:12.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43421 req_id = dcc67e2e-a17f-4ba7-83d8-80732212ee31 response_code = 204 uri = /vpc-routes
18362025-02-28T23:11:12.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43145
18372025-02-28T23:11:12.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43145 req_id = 2a03c8c7-455e-41dd-a401-d9d7909b999b response_code = 200 uri = /vpc-routes
18382025-02-28T23:11:12.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18392025-02-28T23:11:12.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43145 req_id = 01f3eb3d-931a-42da-abb2-0fbd8b5bd826 response_code = 204 uri = /eip-gateways
18402025-02-28T23:11:12.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58750
18412025-02-28T23:11:12.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58750 req_id = 10192313-f19c-40a5-bcb9-e49ad0a3d879 response_code = 200 uri = /v2p
18422025-02-28T23:11:12.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43854
18432025-02-28T23:11:12.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43854 req_id = 783278c1-ab62-4bc4-8da6-73799d57c1eb response_code = 200 uri = /v2p
18442025-02-28T23:11:12.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43145 req_id = e3c1161e-b98a-4235-957d-e2b632860de1 response_code = 204 uri = /vpc-routes
18452025-02-28T23:11:12.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41321
18462025-02-28T23:11:12.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41321 req_id = 47087ff9-3dfc-4688-af8c-fe5b17566baa response_code = 200 uri = /vpc-routes
18472025-02-28T23:11:12.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60175
18482025-02-28T23:11:12.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18492025-02-28T23:11:12.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18502025-02-28T23:11:13.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60175 req_id = 5aeac4c3-dcf4-4ef1-a056-6d47c900746a response_code = 204 uri = /switch-ports
18512025-02-28T23:11:13.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40465
18522025-02-28T23:11:13.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48257
18532025-02-28T23:11:13.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18542025-02-28T23:11:13.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41321 req_id = 2a778216-7c20-45b4-ac59-b14e45849aa9 response_code = 204 uri = /eip-gateways
18552025-02-28T23:11:13.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18562025-02-28T23:11:13.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60175 req_id = bca0b100-ee09-4fe5-8131-72d5a7bdf318 response_code = 200 uri = /network-bootstore-config
18572025-02-28T23:11:13.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48257 req_id = 064ee8b4-2319-4905-ae78-434375a67817 response_code = 200 uri = /v2p
18582025-02-28T23:11:13.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51430
18592025-02-28T23:11:13.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41321 req_id = e13e8552-dcc8-4d0a-a885-4e17306ea41d response_code = 204 uri = /vpc-routes
18602025-02-28T23:11:13.073ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18612025-02-28T23:11:13.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18622025-02-28T23:11:13.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40465 req_id = 582000af-88a5-44ba-becb-09fb6f664a6e response_code = 204 uri = /switch-ports
18632025-02-28T23:11:13.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40465 req_id = 2f639a3b-9d0a-4ae7-9454-a14ec5a50e76 response_code = 200 uri = /network-bootstore-config
18642025-02-28T23:11:13.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18652025-02-28T23:11:13.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51430 req_id = 2521196f-701b-4478-b40f-a08b560562e7 response_code = 204 uri = /switch-ports
18662025-02-28T23:11:13.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51430 req_id = 6c3383f0-edbb-4572-ad7f-850e0fa11ac4 response_code = 200 uri = /network-bootstore-config
18672025-02-28T23:11:22.942ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53441
18682025-02-28T23:11:22.942ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53441 req_id = ae32713b-3b75-42e1-8d21-202f120bb0f3 response_code = 200 uri = /baseboard
18692025-02-28T23:11:23.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6708 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = e918bb7c-34ca-4687-b806-da2d07b10825 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
18702025-02-28T23:11:42.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56111
18712025-02-28T23:11:42.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56111 req_id = ed3255f7-1cea-475a-ac2b-31a0a6308e6e response_code = 200 uri = /vpc-routes
18722025-02-28T23:11:42.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62273
18732025-02-28T23:11:42.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62273 req_id = 38fc19a3-2c6a-4c2f-af5d-7684db67fdca response_code = 200 uri = /vpc-routes
18742025-02-28T23:11:42.617ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18752025-02-28T23:11:42.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56111 req_id = 5c12158b-267c-486c-ab08-60dce0fa7946 response_code = 204 uri = /eip-gateways
18762025-02-28T23:11:42.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38343
18772025-02-28T23:11:42.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38343 req_id = 25340a34-98e3-4c17-964b-639a0886bcc8 response_code = 200 uri = /v2p
18782025-02-28T23:11:42.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56111 req_id = 1baae553-871c-4804-b5dd-54fd40bb42d0 response_code = 204 uri = /vpc-routes
18792025-02-28T23:11:42.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18802025-02-28T23:11:42.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62273 req_id = bdd253d3-3de9-49b3-ad74-dd4fd2ae12ad response_code = 204 uri = /eip-gateways
18812025-02-28T23:11:42.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62273 req_id = bfd75abf-2677-424c-a384-43d13e8b8209 response_code = 204 uri = /vpc-routes
18822025-02-28T23:11:42.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47456
18832025-02-28T23:11:42.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18842025-02-28T23:11:42.728ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18852025-02-28T23:11:42.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47456 req_id = c676fe6d-127b-4047-84a9-a12db41168c1 response_code = 204 uri = /switch-ports
18862025-02-28T23:11:42.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43836
18872025-02-28T23:11:42.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47456 req_id = 39b14ea8-c80b-4859-b944-d5b302cf8b3b response_code = 200 uri = /network-bootstore-config
18882025-02-28T23:11:42.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43836 req_id = 0c804f6f-1643-4152-909e-8b6ef6a58684 response_code = 200 uri = /v2p
18892025-02-28T23:11:42.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49200
18902025-02-28T23:11:42.793ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18912025-02-28T23:11:42.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40346
18922025-02-28T23:11:42.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40346 req_id = 6dcb1425-ae99-4e41-801c-b72a1718331e response_code = 200 uri = /vpc-routes
18932025-02-28T23:11:42.835ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18942025-02-28T23:11:42.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
18952025-02-28T23:11:42.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40346 req_id = d847a9af-d2eb-4953-bcdb-77dc95bc38ac response_code = 204 uri = /eip-gateways
18962025-02-28T23:11:42.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40346 req_id = 7ac352ae-d871-4861-aa7c-9e1740f53b5f response_code = 204 uri = /vpc-routes
18972025-02-28T23:11:42.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49200 req_id = 9e54dbfd-3a58-450c-b188-ef3e2ba75cf2 response_code = 204 uri = /switch-ports
18982025-02-28T23:11:42.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49200 req_id = 45dd1838-5a2a-40c5-b01f-e2365ffe6507 response_code = 200 uri = /network-bootstore-config
18992025-02-28T23:11:42.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58848
19002025-02-28T23:11:42.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19012025-02-28T23:11:42.948ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19022025-02-28T23:11:43.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58848 req_id = bac17a23-cc65-494a-951c-3d7fdf1b16ce response_code = 204 uri = /switch-ports
19032025-02-28T23:11:43.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36313
19042025-02-28T23:11:43.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36313 req_id = 391ab4de-77c8-4fef-b4ed-9f43b895dbcd response_code = 200 uri = /v2p
19052025-02-28T23:11:43.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58848 req_id = 3511621e-02eb-4924-935e-a26ec46a9169 response_code = 200 uri = /network-bootstore-config
19062025-02-28T23:11:52.975ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61864
19072025-02-28T23:11:52.975ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61864 req_id = 86a227a5-f166-4c58-84f4-671d1d6fb2c5 response_code = 200 uri = /baseboard
19082025-02-28T23:11:53.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6885 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 11a97dcd-4fda-4d9f-874f-c2aff0f43d2f response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
19092025-02-28T23:12:12.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52661
19102025-02-28T23:12:12.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52661 req_id = a3bc0e4a-2d3c-4758-a036-e9b058d0f933 response_code = 200 uri = /vpc-routes
19112025-02-28T23:12:12.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19122025-02-28T23:12:12.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52661 req_id = d9959640-ee96-47be-8e27-8817a65af3e5 response_code = 204 uri = /eip-gateways
19132025-02-28T23:12:12.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52661 req_id = 36884a0e-9470-4b4c-884d-481b70096569 response_code = 204 uri = /vpc-routes
19142025-02-28T23:12:12.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40192
19152025-02-28T23:12:12.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40192 req_id = a424a9a3-4e43-4a1f-8396-349416a4b977 response_code = 200 uri = /vpc-routes
19162025-02-28T23:12:12.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19172025-02-28T23:12:12.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40192 req_id = 84589e34-5878-4d2c-93d9-b1470b03b42c response_code = 204 uri = /eip-gateways
19182025-02-28T23:12:12.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54389
19192025-02-28T23:12:12.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54389 req_id = e9372310-01f7-4d55-8255-f466138f9034 response_code = 200 uri = /v2p
19202025-02-28T23:12:12.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47818
19212025-02-28T23:12:12.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19222025-02-28T23:12:12.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19232025-02-28T23:12:12.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47818 req_id = 5c788831-a07c-46f9-b0e7-7c35c48b4761 response_code = 204 uri = /switch-ports
19242025-02-28T23:12:12.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33401
19252025-02-28T23:12:12.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37538
19262025-02-28T23:12:12.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33401 req_id = 79d4bd6b-2629-4973-8369-ead2e538b4d9 response_code = 200 uri = /vpc-routes
19272025-02-28T23:12:12.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47818 req_id = f328d53a-578b-4c9a-9194-c3984e3e6d93 response_code = 200 uri = /network-bootstore-config
19282025-02-28T23:12:12.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37538 req_id = 4a6fb626-9511-4abb-a5ba-b8025f3a7ac1 response_code = 200 uri = /v2p
19292025-02-28T23:12:12.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40192 req_id = 5c00eda9-9a02-4ceb-ab92-5ad9ce8ae43d response_code = 204 uri = /vpc-routes
19302025-02-28T23:12:13.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19312025-02-28T23:12:13.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33401 req_id = d21e12dd-9c15-4f56-9cf7-31171a74f481 response_code = 204 uri = /eip-gateways
19322025-02-28T23:12:13.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33841
19332025-02-28T23:12:13.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19342025-02-28T23:12:13.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19352025-02-28T23:12:13.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33841 req_id = 6bbacb2d-e4ed-44f9-84a7-b95dd3222285 response_code = 204 uri = /switch-ports
19362025-02-28T23:12:13.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51232
19372025-02-28T23:12:13.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62997
19382025-02-28T23:12:13.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33401 req_id = 85f446cb-4400-4efd-8a7b-31a87c623f46 response_code = 204 uri = /vpc-routes
19392025-02-28T23:12:13.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33841 req_id = 1546266f-a4ba-42ca-81dd-e1693955cf5a response_code = 200 uri = /network-bootstore-config
19402025-02-28T23:12:13.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51232 req_id = 0c34a9fe-f0de-40f2-8b0e-9bfcbed367ad response_code = 200 uri = /v2p
19412025-02-28T23:12:13.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19422025-02-28T23:12:13.183ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19432025-02-28T23:12:13.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62997 req_id = 887d1e1c-7d2f-40b4-82ce-488e8a66a4f5 response_code = 204 uri = /switch-ports
19442025-02-28T23:12:13.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62997 req_id = 97901895-21c8-4020-9dc4-eb648407aaa6 response_code = 200 uri = /network-bootstore-config
19452025-02-28T23:12:15.304ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19462025-02-28T23:12:23.008ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44807
19472025-02-28T23:12:23.008ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44807 req_id = 76906a15-8966-4932-94e9-f9d016b46d58 response_code = 200 uri = /baseboard
19482025-02-28T23:12:23.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7284 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 2470b05f-5769-4c14-a66a-56cc49395fc5 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
19492025-02-28T23:12:42.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42960
19502025-02-28T23:12:42.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42960 req_id = d6e0ee65-3541-4642-b85b-f0a9535df66c response_code = 200 uri = /vpc-routes
19512025-02-28T23:12:42.569ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19522025-02-28T23:12:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42960 req_id = 95cf72e1-5b61-445a-8d00-5e12b253968b response_code = 204 uri = /eip-gateways
19532025-02-28T23:12:42.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55601
19542025-02-28T23:12:42.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55601 req_id = 08fbebef-8193-4e76-9a41-7b89700904ba response_code = 200 uri = /v2p
19552025-02-28T23:12:42.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42960 req_id = d0998387-8bb1-4581-a066-5803560427ea response_code = 204 uri = /vpc-routes
19562025-02-28T23:12:42.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61206
19572025-02-28T23:12:42.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61206 req_id = 292b0fa7-586e-41e5-acb4-766c0c6ff3d5 response_code = 200 uri = /vpc-routes
19582025-02-28T23:12:42.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38437
19592025-02-28T23:12:42.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19602025-02-28T23:12:42.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19612025-02-28T23:12:42.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38437 req_id = 0fe5ebfc-f224-4148-bc23-f57d363e79cf response_code = 204 uri = /switch-ports
19622025-02-28T23:12:42.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40141
19632025-02-28T23:12:42.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19642025-02-28T23:12:42.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19652025-02-28T23:12:42.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61206 req_id = a0b384d6-39d9-4fcd-b318-5cf06b90986b response_code = 204 uri = /eip-gateways
19662025-02-28T23:12:42.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38437 req_id = aa22a7b9-d81a-4f50-b429-46910705ae06 response_code = 200 uri = /network-bootstore-config
19672025-02-28T23:12:42.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61206 req_id = 44bcb733-1094-471c-9830-69689cce79c1 response_code = 204 uri = /vpc-routes
19682025-02-28T23:12:42.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58527
19692025-02-28T23:12:42.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58527 req_id = 44e554e2-6856-4a89-9818-2d963bde0e69 response_code = 200 uri = /vpc-routes
19702025-02-28T23:12:42.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19712025-02-28T23:12:42.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 583 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58527 req_id = a081fe27-869a-4672-9c60-911c69d96080 response_code = 204 uri = /eip-gateways
19722025-02-28T23:12:42.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19732025-02-28T23:12:42.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 901 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58527 req_id = 07603ba0-851b-45e8-80a3-f18ab136a440 response_code = 204 uri = /vpc-routes
19742025-02-28T23:12:42.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38340
19752025-02-28T23:12:42.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38340 req_id = 3691baba-8da1-4a56-9c48-766ccf68ddc9 response_code = 200 uri = /v2p
19762025-02-28T23:12:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48602
19772025-02-28T23:12:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48602 req_id = 7656d307-eab2-4ece-af82-7ce8e320fa5c response_code = 200 uri = /v2p
19782025-02-28T23:12:42.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40141 req_id = 38bac0ad-7f10-4f66-aae6-3861565035fa response_code = 204 uri = /switch-ports
19792025-02-28T23:12:42.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40141 req_id = 34534636-fcae-4fc9-af94-5a4311a07c87 response_code = 200 uri = /network-bootstore-config
19802025-02-28T23:12:42.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55011
19812025-02-28T23:12:42.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19822025-02-28T23:12:42.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19832025-02-28T23:12:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55011 req_id = a1b61c99-f683-40fc-8cbd-b937b798812e response_code = 204 uri = /switch-ports
19842025-02-28T23:12:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55011 req_id = 4b80e562-083d-4df1-8987-2c9ff7fd40ea response_code = 200 uri = /network-bootstore-config
19852025-02-28T23:12:53.042ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49190
19862025-02-28T23:12:53.042ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49190 req_id = 515f08b3-96ca-4b73-a80d-e00603e06a93 response_code = 200 uri = /baseboard
19872025-02-28T23:12:53.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7039 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 5b63fe7d-6e75-43cb-86f9-48d979638628 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
19882025-02-28T23:13:12.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59144
19892025-02-28T23:13:12.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59144 req_id = 8aec1ef6-295c-42d4-b345-0e0dc4157f05 response_code = 200 uri = /vpc-routes
19902025-02-28T23:13:12.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19912025-02-28T23:13:12.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59144 req_id = 170d4a80-6f74-4f53-b9c2-26f2a22e5d59 response_code = 204 uri = /eip-gateways
19922025-02-28T23:13:12.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59144 req_id = 6daec7b9-02ca-4063-8c87-58b5eea2cc98 response_code = 204 uri = /vpc-routes
19932025-02-28T23:13:12.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44096
19942025-02-28T23:13:12.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44096 req_id = de7dce69-3ade-4778-82e6-5c3d7d554f9d response_code = 200 uri = /vpc-routes
19952025-02-28T23:13:12.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
19962025-02-28T23:13:12.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44096 req_id = cded9a17-b99e-4af9-a9ff-01decbf2c532 response_code = 204 uri = /eip-gateways
19972025-02-28T23:13:12.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44096 req_id = 00ad2969-725e-4418-9b48-349606894b61 response_code = 204 uri = /vpc-routes
19982025-02-28T23:13:12.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43727
19992025-02-28T23:13:12.909ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20002025-02-28T23:13:12.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20012025-02-28T23:13:13.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43727 req_id = c3b00701-815f-43fd-84eb-68fe00ba06e8 response_code = 204 uri = /switch-ports
20022025-02-28T23:13:13.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37318
20032025-02-28T23:13:13.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49068
20042025-02-28T23:13:13.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34848
20052025-02-28T23:13:13.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43455
20062025-02-28T23:13:13.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37318 req_id = 28eaa666-a527-4534-a892-deb5f2d9291e response_code = 200 uri = /vpc-routes
20072025-02-28T23:13:13.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43455 req_id = 709d496a-d56a-4ddf-9891-1844aa8e3475 response_code = 200 uri = /v2p
20082025-02-28T23:13:13.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43727 req_id = b5ae8d9a-e7bf-459b-8613-b6aa34340c06 response_code = 200 uri = /network-bootstore-config
20092025-02-28T23:13:13.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34848 req_id = 7568ac9f-1297-4c6b-94bd-53de327ee548 response_code = 200 uri = /v2p
20102025-02-28T23:13:13.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49068 req_id = bd192732-1977-440b-b788-360b82b658f7 response_code = 200 uri = /v2p
20112025-02-28T23:13:13.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57222
20122025-02-28T23:13:13.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20132025-02-28T23:13:13.075ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20142025-02-28T23:13:13.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57222 req_id = 714b3004-8738-4ec3-af78-9a84579cd1cb response_code = 204 uri = /switch-ports
20152025-02-28T23:13:13.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34772
20162025-02-28T23:13:13.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20172025-02-28T23:13:13.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37318 req_id = 61a2f97c-2fd0-4703-9285-2494f313e1ab response_code = 204 uri = /eip-gateways
20182025-02-28T23:13:13.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57222 req_id = 0203f159-a6b0-41c5-8f68-318a4bea8c24 response_code = 200 uri = /network-bootstore-config
20192025-02-28T23:13:13.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20202025-02-28T23:13:13.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37318 req_id = 9f3344af-95ad-4ace-8b5c-7c2e615e25ae response_code = 204 uri = /vpc-routes
20212025-02-28T23:13:13.184ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20222025-02-28T23:13:13.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34772 req_id = 28e1715a-f20f-47ef-98cc-88b89491e49d response_code = 204 uri = /switch-ports
20232025-02-28T23:13:13.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34772 req_id = 46e7fb9e-d059-4212-9aed-840d91cc6cf5 response_code = 200 uri = /network-bootstore-config
20242025-02-28T23:13:23.076ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61438
20252025-02-28T23:13:23.076ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61438 req_id = 8cc190cf-ee90-40fa-89f2-d8bb9e1b296e response_code = 200 uri = /baseboard
20262025-02-28T23:13:23.285ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11772 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 382f6eb6-0e80-4e91-90df-d76f8f4abea9 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
20272025-02-28T23:13:42.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56829
20282025-02-28T23:13:42.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56829 req_id = 069c4b5e-efcd-403e-a240-7d6e58a5258a response_code = 200 uri = /v2p
20292025-02-28T23:13:42.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41710
20302025-02-28T23:13:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41710 req_id = 19954c73-a22a-46cd-b0bb-c1cd37ff7f47 response_code = 200 uri = /vpc-routes
20312025-02-28T23:13:42.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54448
20322025-02-28T23:13:42.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54448 req_id = 363f9809-2f59-4b66-88db-909191ce2c88 response_code = 200 uri = /vpc-routes
20332025-02-28T23:13:42.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20342025-02-28T23:13:42.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54448 req_id = 67a749d5-f3be-43dd-b064-5527aba4ae84 response_code = 204 uri = /eip-gateways
20352025-02-28T23:13:42.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54448 req_id = 7a130256-8264-4655-8df8-8dd0c84ced87 response_code = 204 uri = /vpc-routes
20362025-02-28T23:13:42.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20372025-02-28T23:13:42.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41710 req_id = c91702e9-1ae6-493d-b94f-2fd2c7c78cbc response_code = 204 uri = /eip-gateways
20382025-02-28T23:13:42.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41710 req_id = 42956f72-4c39-4416-ba83-9965c3abf7db response_code = 204 uri = /vpc-routes
20392025-02-28T23:13:42.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51592
20402025-02-28T23:13:42.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20412025-02-28T23:13:42.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20422025-02-28T23:13:42.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51592 req_id = ea945232-795a-40b0-8042-1c35ddc0d3c6 response_code = 204 uri = /switch-ports
20432025-02-28T23:13:42.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63947
20442025-02-28T23:13:42.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56750
20452025-02-28T23:13:42.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34671
20462025-02-28T23:13:42.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51592 req_id = 9e938339-b6a4-4765-acff-eb3dcd121c63 response_code = 200 uri = /network-bootstore-config
20472025-02-28T23:13:42.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63947 req_id = 69a44e7e-5b33-43a1-aabb-e1550c81ed1d response_code = 200 uri = /vpc-routes
20482025-02-28T23:13:42.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20492025-02-28T23:13:42.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56750 req_id = dadc0c95-cd5d-45c5-949c-8e85e3fb1da4 response_code = 200 uri = /v2p
20502025-02-28T23:13:42.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20512025-02-28T23:13:42.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63947 req_id = 910d0a2c-5a36-43fe-99b6-4ccdf14150d0 response_code = 204 uri = /eip-gateways
20522025-02-28T23:13:42.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20532025-02-28T23:13:42.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60994
20542025-02-28T23:13:42.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60994 req_id = 88a5cf9e-cf18-4c1c-bd93-d36a0de05436 response_code = 200 uri = /v2p
20552025-02-28T23:13:42.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63947 req_id = 1befe5d5-243a-4fdb-96c3-21ccdbfb9f85 response_code = 204 uri = /vpc-routes
20562025-02-28T23:13:42.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34671 req_id = ea2cbdc0-e6b7-4d7e-b860-9b7a789bc499 response_code = 204 uri = /switch-ports
20572025-02-28T23:13:42.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34671 req_id = f201f553-897a-4af2-9ab3-ff91ef36f27c response_code = 200 uri = /network-bootstore-config
20582025-02-28T23:13:42.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42812
20592025-02-28T23:13:42.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20602025-02-28T23:13:42.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20612025-02-28T23:13:42.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42812 req_id = e23aeb02-2d2b-4489-b878-9f86d77e6479 response_code = 204 uri = /switch-ports
20622025-02-28T23:13:42.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42812 req_id = 8828140c-cc49-43eb-b6dd-468978a9b857 response_code = 200 uri = /network-bootstore-config
20632025-02-28T23:13:53.109ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45826
20642025-02-28T23:13:53.109ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45826 req_id = 76a2ba56-f48b-4cd5-8476-123fde849734 response_code = 200 uri = /baseboard
20652025-02-28T23:13:53.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7543 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 46fb9313-263f-4817-ad8e-83c7f40b8078 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
20662025-02-28T23:14:12.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36974
20672025-02-28T23:14:12.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36974 req_id = 4de4cccc-44e8-47b0-ad90-7715acb6be8f response_code = 200 uri = /vpc-routes
20682025-02-28T23:14:12.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50191
20692025-02-28T23:14:12.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20702025-02-28T23:14:12.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50191 req_id = 1aced9b9-3f4f-481f-a36a-ffff1dd17d8d response_code = 200 uri = /artifacts
20712025-02-28T23:14:12.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20722025-02-28T23:14:12.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36974 req_id = a4fe1966-2b97-41b3-935f-04d8d9dcc796 response_code = 204 uri = /eip-gateways
20732025-02-28T23:14:12.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36974 req_id = e3093683-a754-4deb-bc97-7ef10da7cc10 response_code = 204 uri = /vpc-routes
20742025-02-28T23:14:12.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34309
20752025-02-28T23:14:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34309 req_id = ee0be2a4-8610-4641-9297-2f75f42d71e5 response_code = 200 uri = /vpc-routes
20762025-02-28T23:14:12.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62243
20772025-02-28T23:14:12.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20782025-02-28T23:14:12.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62243 req_id = 3a14d0f2-a87e-4cd3-9df1-512886f41500 response_code = 200 uri = /artifacts
20792025-02-28T23:14:12.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
20802025-02-28T23:14:12.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34309 req_id = 613263f0-8147-499b-8e18-5f1161857108 response_code = 204 uri = /eip-gateways
20812025-02-28T23:14:12.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46784
20822025-02-28T23:14:12.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46784 req_id = 0da76ee7-7128-4096-a4bb-396f8e2ee648 response_code = 200 uri = /vpc-routes
20832025-02-28T23:14:12.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34309 req_id = 746c9376-261c-48e6-a2fd-f93a228dd03a response_code = 204 uri = /vpc-routes
20842025-02-28T23:14:12.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58696
20852025-02-28T23:14:12.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20862025-02-28T23:14:12.948ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20872025-02-28T23:14:13.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58696 req_id = 2464524b-d3de-42ab-a1ae-f5ef4531bbe4 response_code = 204 uri = /switch-ports
20882025-02-28T23:14:13.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51453
20892025-02-28T23:14:13.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46534
20902025-02-28T23:14:13.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61394
20912025-02-28T23:14:13.013ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20922025-02-28T23:14:13.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3912 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51453 req_id = 0bc3feb2-3bda-4537-8b99-fe15f930b600 response_code = 200 uri = /v2p
20932025-02-28T23:14:13.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58696 req_id = 5ae35fed-04c6-4425-b66c-d6cff2260cfb response_code = 200 uri = /network-bootstore-config
20942025-02-28T23:14:13.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46534 req_id = 0372aa1e-c529-4511-8714-825b48f74ad5 response_code = 200 uri = /v2p
20952025-02-28T23:14:13.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20962025-02-28T23:14:13.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61394 req_id = 9a3f65ef-1e6b-4c3a-8dcb-ceeba14573e5 response_code = 204 uri = /switch-ports
20972025-02-28T23:14:13.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61394 req_id = 5da2b533-f65f-41a2-b990-59da2795ff90 response_code = 200 uri = /network-bootstore-config
20982025-02-28T23:14:13.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61315
20992025-02-28T23:14:13.109ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21002025-02-28T23:14:13.109ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21012025-02-28T23:14:13.109ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21022025-02-28T23:14:13.109ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21032025-02-28T23:14:13.109ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21042025-02-28T23:14:13.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21052025-02-28T23:14:13.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21062025-02-28T23:14:13.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61315 req_id = 3a0aa84d-1238-4230-af44-490bddce3db2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21072025-02-28T23:14:13.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43916
21082025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21092025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21102025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21112025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21122025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21132025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21142025-02-28T23:14:13.133ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21152025-02-28T23:14:13.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43916 req_id = d75ca101-8276-4873-a963-804992f21515 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21162025-02-28T23:14:13.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48476
21172025-02-28T23:14:13.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21182025-02-28T23:14:13.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48476 req_id = b0997969-d8f3-4021-9e56-4a0891958601 response_code = 200 uri = /artifacts
21192025-02-28T23:14:13.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21202025-02-28T23:14:13.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46784 req_id = cbbf4e24-6bd0-43d8-a2a5-c90e5125bae4 response_code = 204 uri = /eip-gateways
21212025-02-28T23:14:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46784 req_id = 3310ee90-1a45-4591-b9ed-8804a9723b84 response_code = 204 uri = /vpc-routes
21222025-02-28T23:14:13.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44112
21232025-02-28T23:14:13.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44112 req_id = f8938fe1-297a-4c96-9a73-74a9d5038297 response_code = 200 uri = /v2p
21242025-02-28T23:14:13.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56309
21252025-02-28T23:14:13.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21262025-02-28T23:14:13.359ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21272025-02-28T23:14:13.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56309 req_id = 89a6b448-8bde-48fd-b8bd-39448666bd6c response_code = 204 uri = /switch-ports
21282025-02-28T23:14:13.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56309 req_id = 3a64fc3d-8ca4-4fa7-94d7-1940a5432488 response_code = 200 uri = /network-bootstore-config
21292025-02-28T23:14:13.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59179
21302025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21312025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21322025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21332025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21342025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21352025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21362025-02-28T23:14:13.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21372025-02-28T23:14:13.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59179 req_id = 7919e4e5-d486-4c1f-874a-ef6cc6a10e61 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21382025-02-28T23:14:23.142ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45579
21392025-02-28T23:14:23.142ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45579 req_id = 054754ca-993b-477f-a68c-8a5c76cbe6f5 response_code = 200 uri = /baseboard
21402025-02-28T23:14:23.283ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8576 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 20b6b00a-c67c-42c3-b7fa-84e28b0dc893 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
21412025-02-28T23:14:42.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37258
21422025-02-28T23:14:42.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37258 req_id = 713cc683-2753-4d8f-85fc-21f0cb1a9947 response_code = 200 uri = /vpc-routes
21432025-02-28T23:14:42.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65495
21442025-02-28T23:14:42.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65495 req_id = 5202ddd7-dad7-436b-815a-5898e75cfcc4 response_code = 200 uri = /vpc-routes
21452025-02-28T23:14:42.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21462025-02-28T23:14:42.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37258 req_id = 0d531874-4e30-463b-a035-ce2148120637 response_code = 204 uri = /eip-gateways
21472025-02-28T23:14:42.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37258 req_id = 81f73f72-df08-4266-a612-59315bedcaf2 response_code = 204 uri = /vpc-routes
21482025-02-28T23:14:42.659ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21492025-02-28T23:14:42.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65495 req_id = 9de172b6-7472-4017-a5ea-182d58374f76 response_code = 204 uri = /eip-gateways
21502025-02-28T23:14:42.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49546
21512025-02-28T23:14:42.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21522025-02-28T23:14:42.711ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21532025-02-28T23:14:42.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114582 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49546 req_id = d1a1eed0-257b-4413-abd5-48d4df597537 response_code = 204 uri = /switch-ports
21542025-02-28T23:14:42.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61167
21552025-02-28T23:14:42.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60551
21562025-02-28T23:14:42.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21572025-02-28T23:14:42.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60551 req_id = bd6ebb28-e19a-46d2-97de-72130245b24c response_code = 200 uri = /v2p
21582025-02-28T23:14:42.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49546 req_id = 135edad3-b51c-43c7-aef7-0108e568331d response_code = 200 uri = /network-bootstore-config
21592025-02-28T23:14:42.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65495 req_id = 440cb676-cae8-4735-90f4-7c04ea8f4d9d response_code = 204 uri = /vpc-routes
21602025-02-28T23:14:42.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44660
21612025-02-28T23:14:42.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44660 req_id = f122901c-d395-4cc6-911e-26e65a7256bf response_code = 200 uri = /v2p
21622025-02-28T23:14:42.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21632025-02-28T23:14:42.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62690
21642025-02-28T23:14:42.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62690 req_id = c12efc97-d9c6-4045-8547-4acc66b43ee8 response_code = 200 uri = /v2p
21652025-02-28T23:14:42.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33682
21662025-02-28T23:14:42.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33682 req_id = 1845b8dd-9d59-4695-86bb-e32145fc9bd6 response_code = 200 uri = /vpc-routes
21672025-02-28T23:14:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61167 req_id = e1ad154e-ec50-48f3-a836-7496b3fa54f8 response_code = 204 uri = /switch-ports
21682025-02-28T23:14:42.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61167 req_id = 26656346-b18a-4093-809a-7cd7e489fa1a response_code = 200 uri = /network-bootstore-config
21692025-02-28T23:14:42.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21702025-02-28T23:14:42.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33682 req_id = 1a625172-fc03-43ea-949f-8b1f64fbd78e response_code = 204 uri = /eip-gateways
21712025-02-28T23:14:42.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41836
21722025-02-28T23:14:42.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21732025-02-28T23:14:42.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21742025-02-28T23:14:43.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101127 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41836 req_id = bc2cdcb9-e8a0-44a4-99bc-703aceea39bc response_code = 204 uri = /switch-ports
21752025-02-28T23:14:43.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33682 req_id = 0a0ac465-4b5a-4423-bdda-8eec3161d4ea response_code = 204 uri = /vpc-routes
21762025-02-28T23:14:43.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41836 req_id = f76e7889-4fb9-4eac-a64a-5813a245ce09 response_code = 200 uri = /network-bootstore-config
21772025-02-28T23:14:53.177ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39252
21782025-02-28T23:14:53.177ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39252 req_id = 5f51cab0-5a7a-418d-90a1-9d24201db2cc response_code = 200 uri = /baseboard
21792025-02-28T23:14:53.284ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10086 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 93e96b7d-9e38-45bf-b3a0-bad8f823b2d9 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
21802025-02-28T23:15:12.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62554
21812025-02-28T23:15:12.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62554 req_id = 6fbd3d1e-6900-4fcc-afe2-eaabce8965e8 response_code = 200 uri = /vpc-routes
21822025-02-28T23:15:12.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21832025-02-28T23:15:12.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62554 req_id = 870a53a5-52dd-40b3-be9a-7323e1b695fe response_code = 204 uri = /eip-gateways
21842025-02-28T23:15:12.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62554 req_id = d38f1460-9844-4023-9435-c5e8a4150bf3 response_code = 204 uri = /vpc-routes
21852025-02-28T23:15:12.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60429
21862025-02-28T23:15:12.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60429 req_id = 9663394c-6df2-4511-9f92-b0b20e839383 response_code = 200 uri = /vpc-routes
21872025-02-28T23:15:12.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
21882025-02-28T23:15:12.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60429 req_id = 83955fe4-699d-4bb0-b120-0db63dae3932 response_code = 204 uri = /eip-gateways
21892025-02-28T23:15:12.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52554
21902025-02-28T23:15:12.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52554 req_id = 4f3f20d5-42b3-438b-92a9-13e8feaeb9c3 response_code = 200 uri = /v2p
21912025-02-28T23:15:12.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60429 req_id = 9403fe53-5b1b-4662-a546-ee23c762022f response_code = 204 uri = /vpc-routes
21922025-02-28T23:15:12.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40930
21932025-02-28T23:15:12.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21942025-02-28T23:15:12.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21952025-02-28T23:15:13.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40930 req_id = 1a5acc37-6ab9-430d-808c-03ac78c23be8 response_code = 204 uri = /switch-ports
21962025-02-28T23:15:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43170
21972025-02-28T23:15:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54529
21982025-02-28T23:15:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48446
21992025-02-28T23:15:13.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22002025-02-28T23:15:13.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43170 req_id = af69ff68-98ad-40c0-b7fd-0cc5ed607567 response_code = 200 uri = /vpc-routes
22012025-02-28T23:15:13.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40930 req_id = 24c0a21b-1e15-46ac-b9a8-5bbcb9847a60 response_code = 200 uri = /network-bootstore-config
22022025-02-28T23:15:13.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54529 req_id = 523e6c20-c50d-48e7-b84d-3e0f980db0c0 response_code = 200 uri = /v2p
22032025-02-28T23:15:13.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57634
22042025-02-28T23:15:13.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22052025-02-28T23:15:13.079ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22062025-02-28T23:15:13.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43170 req_id = 6dc0dd62-dddf-4de4-ba03-cdfe419c1efb response_code = 204 uri = /eip-gateways
22072025-02-28T23:15:13.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43170 req_id = 4a1b4379-69eb-4197-83c0-d08e0cf537a4 response_code = 204 uri = /vpc-routes
22082025-02-28T23:15:13.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48446 req_id = 1bf227e8-994c-458a-82b5-11fbfbb975b0 response_code = 204 uri = /switch-ports
22092025-02-28T23:15:13.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22102025-02-28T23:15:13.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48446 req_id = 21ac1560-6605-4db3-aec1-a7b36d103acb response_code = 200 uri = /network-bootstore-config
22112025-02-28T23:15:13.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56287
22122025-02-28T23:15:13.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56287 req_id = 12ffa200-761a-4761-b1fd-155326f727c9 response_code = 200 uri = /v2p
22132025-02-28T23:15:13.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22142025-02-28T23:15:13.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57634 req_id = 208f21eb-6541-4336-925b-8b01648abcb1 response_code = 204 uri = /switch-ports
22152025-02-28T23:15:13.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57634 req_id = 166f91eb-eac4-4fff-860c-8413c50ea465 response_code = 200 uri = /network-bootstore-config
22162025-02-28T23:15:23.209ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57279
22172025-02-28T23:15:23.209ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57279 req_id = 848cea24-1a9e-408a-afd1-eb2cab2612b3 response_code = 200 uri = /baseboard
22182025-02-28T23:15:23.283ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8321 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = e57b1fae-0d70-4efa-8905-d9237a06930c response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
22192025-02-28T23:15:42.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40002
22202025-02-28T23:15:42.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40002 req_id = 236c1415-cfd9-4089-ab3a-f6fcd8e393b8 response_code = 200 uri = /vpc-routes
22212025-02-28T23:15:42.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43438
22222025-02-28T23:15:42.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43438 req_id = 4fdc705b-c4ec-47ce-acbc-c5d9809881f2 response_code = 200 uri = /v2p
22232025-02-28T23:15:42.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22242025-02-28T23:15:42.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40002 req_id = 889e4294-1050-4254-9743-cc81e409b759 response_code = 204 uri = /eip-gateways
22252025-02-28T23:15:42.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52537
22262025-02-28T23:15:42.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52537 req_id = e640a6dc-3ea4-48d1-92fc-563af668bf5d response_code = 200 uri = /v2p
22272025-02-28T23:15:42.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40002 req_id = fa354f6a-39c6-4a25-8818-6d9f707df3c1 response_code = 204 uri = /vpc-routes
22282025-02-28T23:15:42.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56631
22292025-02-28T23:15:42.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56631 req_id = 61bf87b6-d439-45dc-a438-21abdd468106 response_code = 200 uri = /vpc-routes
22302025-02-28T23:15:42.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22312025-02-28T23:15:42.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56631 req_id = a515c114-cce9-417c-b5ed-794576ee3a8e response_code = 204 uri = /eip-gateways
22322025-02-28T23:15:42.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50799
22332025-02-28T23:15:42.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50799 req_id = 98015e7e-6b40-4051-b05a-c3feacb44c83 response_code = 200 uri = /vpc-routes
22342025-02-28T23:15:42.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56631 req_id = d334df58-6c95-4f29-9cf0-5d21dd96e733 response_code = 204 uri = /vpc-routes
22352025-02-28T23:15:42.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47956
22362025-02-28T23:15:42.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22372025-02-28T23:15:42.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22382025-02-28T23:15:42.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47956 req_id = 734a654a-c38a-429a-8eef-828023cf53c5 response_code = 204 uri = /switch-ports
22392025-02-28T23:15:42.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41593
22402025-02-28T23:15:42.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38956
22412025-02-28T23:15:42.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47405
22422025-02-28T23:15:42.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22432025-02-28T23:15:42.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22442025-02-28T23:15:42.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50799 req_id = db321235-c608-4b0f-8cf5-be8230f9c2e4 response_code = 204 uri = /eip-gateways
22452025-02-28T23:15:42.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3924 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47956 req_id = c7199fc5-796b-4206-b495-7b3b57d61e5f response_code = 200 uri = /network-bootstore-config
22462025-02-28T23:15:42.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47405 req_id = 5917c2b3-3ecd-44b9-a817-96997002f7d7 response_code = 200 uri = /v2p
22472025-02-28T23:15:42.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50799 req_id = eab90f9d-bf7f-428a-a4f1-ed0ad54b9ba1 response_code = 204 uri = /vpc-routes
22482025-02-28T23:15:42.905ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22492025-02-28T23:15:42.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22502025-02-28T23:15:42.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41593 req_id = 9df5d34b-ef37-4fb3-8bce-53d505543c33 response_code = 204 uri = /switch-ports
22512025-02-28T23:15:42.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 785 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41593 req_id = bc88df8e-b7e8-4b35-b7e2-dac3cb2b9f8b response_code = 200 uri = /network-bootstore-config
22522025-02-28T23:15:42.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22532025-02-28T23:15:43.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38956 req_id = d8eeabb1-991c-4348-877a-9ef5d0658599 response_code = 204 uri = /switch-ports
22542025-02-28T23:15:43.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38956 req_id = c784fa24-c867-40ea-816e-e7d1f056cdd5 response_code = 200 uri = /network-bootstore-config
22552025-02-28T23:15:53.241ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34702
22562025-02-28T23:15:53.241ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34702 req_id = e3fb3158-e3ab-4422-a0da-162fe02bdfd6 response_code = 200 uri = /baseboard
22572025-02-28T23:15:53.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7446 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 9ac6a72e-27ef-453f-9143-5be4d0fa0959 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
22582025-02-28T23:16:12.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44062
22592025-02-28T23:16:12.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44062 req_id = bf45968e-f84d-46c6-9e00-512465215038 response_code = 200 uri = /vpc-routes
22602025-02-28T23:16:12.688ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22612025-02-28T23:16:12.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44062 req_id = d17269a1-7893-4426-88bb-9d823262acd9 response_code = 204 uri = /eip-gateways
22622025-02-28T23:16:12.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44062 req_id = 1c0c25bc-71fc-46fc-ba50-8c4ebb4ead9e response_code = 204 uri = /vpc-routes
22632025-02-28T23:16:12.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63135
22642025-02-28T23:16:12.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63135 req_id = fd126b19-a5bb-4eca-8e84-77c0de879a4a response_code = 200 uri = /vpc-routes
22652025-02-28T23:16:12.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52374
22662025-02-28T23:16:12.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52374 req_id = a82ce41c-e26a-4b83-94c3-4f184a5fca21 response_code = 200 uri = /v2p
22672025-02-28T23:16:12.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22682025-02-28T23:16:12.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63135 req_id = b60ca6b6-b07d-457b-952b-677493ea894e response_code = 204 uri = /eip-gateways
22692025-02-28T23:16:12.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63135 req_id = 547944fe-af02-4938-844d-ccce55923d71 response_code = 204 uri = /vpc-routes
22702025-02-28T23:16:12.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48317
22712025-02-28T23:16:12.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48317 req_id = 6e50f237-9089-44c0-9706-a13041f419da response_code = 200 uri = /vpc-routes
22722025-02-28T23:16:12.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
22732025-02-28T23:16:12.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48317 req_id = 894fb747-fd8c-45ec-a078-749f5a4d52e4 response_code = 204 uri = /eip-gateways
22742025-02-28T23:16:12.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48317 req_id = adbd7466-13bb-42d8-b729-37f3b1b3c635 response_code = 204 uri = /vpc-routes
22752025-02-28T23:16:12.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42049
22762025-02-28T23:16:12.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42049 req_id = 934427a8-befe-428f-aa5a-f7cd6988f8d3 response_code = 200 uri = /v2p
22772025-02-28T23:16:12.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35822
22782025-02-28T23:16:12.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22792025-02-28T23:16:12.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22802025-02-28T23:16:13.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35822 req_id = 3b3b2dff-52f1-4a68-821e-2b40936b571e response_code = 204 uri = /switch-ports
22812025-02-28T23:16:13.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52672
22822025-02-28T23:16:13.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22832025-02-28T23:16:13.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22842025-02-28T23:16:13.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52672 req_id = 11c3a695-48d8-4e7d-90f3-9a4d357848f0 response_code = 204 uri = /switch-ports
22852025-02-28T23:16:13.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51534
22862025-02-28T23:16:13.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35054
22872025-02-28T23:16:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35822 req_id = 0cfe218b-9575-4405-b0e3-fdd0e44b2bf2 response_code = 200 uri = /network-bootstore-config
22882025-02-28T23:16:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52672 req_id = 20999f03-e474-41e6-a8c6-0407d32da85b response_code = 200 uri = /network-bootstore-config
22892025-02-28T23:16:13.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22902025-02-28T23:16:13.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3531 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51534 req_id = 1cdbacc8-db8a-4e98-9938-6c091a79d9ab response_code = 200 uri = /v2p
22912025-02-28T23:16:13.162ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22922025-02-28T23:16:13.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35054 req_id = ec634345-8170-41ea-9657-05f55fd8479a response_code = 204 uri = /switch-ports
22932025-02-28T23:16:13.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35054 req_id = 4ea825f7-4093-407c-a278-adae2d429146 response_code = 200 uri = /network-bootstore-config
22942025-02-28T23:16:23.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7866 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = df400f04-4c38-4fb2-b604-b933a2b5e43d response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
22952025-02-28T23:16:23.281ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32934
22962025-02-28T23:16:23.281ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32934 req_id = 32c9fb95-5ea8-4c80-ac89-3c3329e1713b response_code = 200 uri = /baseboard
22972025-02-28T23:16:42.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59413
22982025-02-28T23:16:42.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59413 req_id = 4cbb08d3-2041-4151-9a5d-e757a7886809 response_code = 200 uri = /vpc-routes
22992025-02-28T23:16:42.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57311
23002025-02-28T23:16:42.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57311 req_id = 67ea1328-efed-4ff4-b75f-028876658494 response_code = 200 uri = /v2p
23012025-02-28T23:16:42.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48917
23022025-02-28T23:16:42.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48917 req_id = 6d56ec3a-9a0b-4f95-9850-e0da620078fb response_code = 200 uri = /vpc-routes
23032025-02-28T23:16:42.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23042025-02-28T23:16:42.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48917 req_id = 870482bd-b706-4488-a78b-bcd40550cf1c response_code = 204 uri = /eip-gateways
23052025-02-28T23:16:42.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48917 req_id = cc2fe942-0701-4c70-853d-1739f3c20efd response_code = 204 uri = /vpc-routes
23062025-02-28T23:16:42.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23072025-02-28T23:16:42.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59413 req_id = e0f96468-4b6f-48c1-baa0-190fc6640d99 response_code = 204 uri = /eip-gateways
23082025-02-28T23:16:42.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51817
23092025-02-28T23:16:42.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51817 req_id = 2ce466b3-e8d2-4cb0-a792-fd05e2f99ac5 response_code = 200 uri = /v2p
23102025-02-28T23:16:42.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59413 req_id = daae14ab-7eb1-4ca1-886e-7dffcffd5386 response_code = 204 uri = /vpc-routes
23112025-02-28T23:16:42.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58929
23122025-02-28T23:16:42.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58929 req_id = f9afe24f-8a14-457b-8b1a-941b73d79c1e response_code = 200 uri = /vpc-routes
23132025-02-28T23:16:42.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39038
23142025-02-28T23:16:42.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23152025-02-28T23:16:42.792ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23162025-02-28T23:16:42.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39038 req_id = ef3dc167-7269-4167-a941-1909aa05adff response_code = 204 uri = /switch-ports
23172025-02-28T23:16:42.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35084
23182025-02-28T23:16:42.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23192025-02-28T23:16:42.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39038 req_id = f2dc2225-3894-4e82-923a-0114603c1093 response_code = 200 uri = /network-bootstore-config
23202025-02-28T23:16:42.881ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23212025-02-28T23:16:42.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5026 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58929 req_id = 860cd7df-ed22-42a0-88e5-00f3215c0982 response_code = 204 uri = /eip-gateways
23222025-02-28T23:16:42.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58929 req_id = e5a2608d-93c6-4c55-b99d-a4b0ff6b7174 response_code = 204 uri = /vpc-routes
23232025-02-28T23:16:42.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49927
23242025-02-28T23:16:42.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23252025-02-28T23:16:42.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48881
23262025-02-28T23:16:42.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48881 req_id = 625c2202-251f-4db5-abde-cc1b7a7dae02 response_code = 200 uri = /v2p
23272025-02-28T23:16:43.016ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23282025-02-28T23:16:43.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35084 req_id = ed4833f5-714f-44ed-8364-f49c038b6e80 response_code = 204 uri = /switch-ports
23292025-02-28T23:16:43.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35084 req_id = 2cbc5b2b-0d19-4e1d-8f71-2e6a98d7fe0a response_code = 200 uri = /network-bootstore-config
23302025-02-28T23:16:43.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23312025-02-28T23:16:43.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49927 req_id = 7c3d8991-a561-4004-b2fb-058987ec75cb response_code = 204 uri = /switch-ports
23322025-02-28T23:16:43.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49927 req_id = a44aa554-0d1e-4655-b5b2-c40788e38378 response_code = 200 uri = /network-bootstore-config
23332025-02-28T23:16:53.282ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8252 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 8bd1fa43-f5b6-4e89-8761-c2e0f36aba0f response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
23342025-02-28T23:16:53.315ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36942
23352025-02-28T23:16:53.315ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36942 req_id = 78b90db1-b3a3-4271-85a0-f3542eca974a response_code = 200 uri = /baseboard
23362025-02-28T23:17:01.022ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23372025-02-28T23:17:01.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23382025-02-28T23:17:01.054ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2078, tv_nsec: 873937311 } time_to_next_cleanup = 599.99999612s
23392025-02-28T23:17:12.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48506
23402025-02-28T23:17:12.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48506 req_id = c4efe78b-d6b6-49e2-a5af-19a88d1c2587 response_code = 200 uri = /vpc-routes
23412025-02-28T23:17:12.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23422025-02-28T23:17:12.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48506 req_id = 82c39087-e916-429a-ae62-afa016c7b517 response_code = 204 uri = /eip-gateways
23432025-02-28T23:17:12.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45096
23442025-02-28T23:17:12.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45096 req_id = 729c9413-83de-4a5c-bb69-368d0f9d12e7 response_code = 200 uri = /vpc-routes
23452025-02-28T23:17:12.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23462025-02-28T23:17:12.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45096 req_id = c80b8227-7997-404d-ac5c-00060238d1f6 response_code = 204 uri = /eip-gateways
23472025-02-28T23:17:12.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35104
23482025-02-28T23:17:12.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35104 req_id = c3ac2e8a-a6df-44bf-8473-806a2f3856b3 response_code = 200 uri = /v2p
23492025-02-28T23:17:12.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51207
23502025-02-28T23:17:12.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51207 req_id = cdb3e67d-15fa-4be0-9c7b-876c6664b50f response_code = 200 uri = /v2p
23512025-02-28T23:17:12.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48506 req_id = e6e23507-6953-4ab4-8d58-f5c951a106b6 response_code = 204 uri = /vpc-routes
23522025-02-28T23:17:12.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45096 req_id = 4b4e18f8-80eb-43d7-b607-192b433683f3 response_code = 204 uri = /vpc-routes
23532025-02-28T23:17:12.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36011
23542025-02-28T23:17:12.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23552025-02-28T23:17:12.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23562025-02-28T23:17:12.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36011 req_id = 41d4ad44-4f9d-48d3-a6d0-9589bd0e422f response_code = 204 uri = /switch-ports
23572025-02-28T23:17:12.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60450
23582025-02-28T23:17:12.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36306
23592025-02-28T23:17:12.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23602025-02-28T23:17:12.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36011 req_id = a3dc51da-8b50-4b50-a727-d7948f71994d response_code = 200 uri = /network-bootstore-config
23612025-02-28T23:17:12.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60450 req_id = e0972e8c-f181-44f9-b503-49b2e604c6f9 response_code = 200 uri = /vpc-routes
23622025-02-28T23:17:13.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23632025-02-28T23:17:13.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23642025-02-28T23:17:13.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60450 req_id = 7983f79b-fc45-4bfe-9c9b-4c69ffe8f712 response_code = 204 uri = /eip-gateways
23652025-02-28T23:17:13.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36306 req_id = c7492ed5-8f2e-4601-9c3f-7fdcfeecaf49 response_code = 204 uri = /switch-ports
23662025-02-28T23:17:13.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36306 req_id = 53ff83c8-ab42-4b94-9bec-53bf5b85425a response_code = 200 uri = /network-bootstore-config
23672025-02-28T23:17:13.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33985
23682025-02-28T23:17:13.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33985 req_id = 387f4b7e-39fd-4612-9aa8-85c127670936 response_code = 200 uri = /v2p
23692025-02-28T23:17:13.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60450 req_id = a8eb7661-877d-43cd-977f-cc642960fc82 response_code = 204 uri = /vpc-routes
23702025-02-28T23:17:13.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62832
23712025-02-28T23:17:13.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23722025-02-28T23:17:13.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23732025-02-28T23:17:13.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62832 req_id = b350f7a9-9b40-4355-84b3-944afc299859 response_code = 204 uri = /switch-ports
23742025-02-28T23:17:13.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62832 req_id = 1cdf6193-04fd-405d-9521-fbcfc66942dd response_code = 200 uri = /network-bootstore-config
23752025-02-28T23:17:15.304ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23762025-02-28T23:17:23.282ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7600 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 65d14dbf-1830-4b8f-a8fb-6875a8909249 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
23772025-02-28T23:17:23.348ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40952
23782025-02-28T23:17:23.348ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40952 req_id = 0372967e-1920-40f6-8077-38b2afe6f83e response_code = 200 uri = /baseboard
23792025-02-28T23:17:42.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46472
23802025-02-28T23:17:42.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46472 req_id = 71ab26a6-23e7-4d87-8445-bafb723904ff response_code = 200 uri = /vpc-routes
23812025-02-28T23:17:42.563ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23822025-02-28T23:17:42.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46472 req_id = 737b0018-6f45-4375-97f6-a492f685dc16 response_code = 204 uri = /eip-gateways
23832025-02-28T23:17:42.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46472 req_id = fa6cfb64-2fbe-4e23-a353-fc3017fddaf0 response_code = 204 uri = /vpc-routes
23842025-02-28T23:17:42.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48886
23852025-02-28T23:17:42.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48886 req_id = ae3d6f61-bfda-4006-9106-af8123d245b8 response_code = 200 uri = /vpc-routes
23862025-02-28T23:17:42.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
23872025-02-28T23:17:42.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48886 req_id = 1944c1f2-1ca9-4414-aac8-7f1759f5be91 response_code = 204 uri = /eip-gateways
23882025-02-28T23:17:42.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33481
23892025-02-28T23:17:42.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33481 req_id = c87d18ac-4a9c-418a-9635-4c144712c992 response_code = 200 uri = /v2p
23902025-02-28T23:17:42.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48886 req_id = 9410ddb3-c9b7-4850-9d55-5403707e0ad3 response_code = 204 uri = /vpc-routes
23912025-02-28T23:17:42.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55220
23922025-02-28T23:17:42.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23932025-02-28T23:17:42.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23942025-02-28T23:17:42.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55220 req_id = 94d0064c-f1a5-4ec2-9830-f6b62b481601 response_code = 204 uri = /switch-ports
23952025-02-28T23:17:42.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49409
23962025-02-28T23:17:42.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37603
23972025-02-28T23:17:42.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49409 req_id = eeea5dd7-a8cf-4f08-904b-2f4c9ad987a1 response_code = 200 uri = /v2p
23982025-02-28T23:17:42.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55220 req_id = 891f39c8-2363-4e18-ba8c-955cd04043de response_code = 200 uri = /network-bootstore-config
23992025-02-28T23:17:42.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24002025-02-28T23:17:42.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24012025-02-28T23:17:42.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64174
24022025-02-28T23:17:42.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64174 req_id = 8bb8c579-2eca-4e6f-a347-598f07809fdb response_code = 200 uri = /vpc-routes
24032025-02-28T23:17:42.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37603 req_id = 5a85aad1-8c3d-4485-9e7e-086e8c014cbe response_code = 204 uri = /switch-ports
24042025-02-28T23:17:42.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37603 req_id = 14e148df-ff9b-4d78-9383-2cd39ea90fdf response_code = 200 uri = /network-bootstore-config
24052025-02-28T23:17:42.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24062025-02-28T23:17:42.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64174 req_id = c12c07a8-497e-42ed-8284-5cc65730e106 response_code = 204 uri = /eip-gateways
24072025-02-28T23:17:42.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61773
24082025-02-28T23:17:42.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61773 req_id = d3be9392-d79e-43c8-9c15-8d0d6130c6c6 response_code = 200 uri = /v2p
24092025-02-28T23:17:42.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64174 req_id = d432ecf2-4b60-44aa-83f9-3bb3cba6b306 response_code = 204 uri = /vpc-routes
24102025-02-28T23:17:42.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57165
24112025-02-28T23:17:42.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24122025-02-28T23:17:43.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24132025-02-28T23:17:43.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57165 req_id = ce9789e9-39fd-4320-9163-3390fd1e1e97 response_code = 204 uri = /switch-ports
24142025-02-28T23:17:43.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57165 req_id = 36b06f42-6b85-42e1-870b-6925027433b0 response_code = 200 uri = /network-bootstore-config
24152025-02-28T23:17:53.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7404 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 90de5e0a-5ade-4423-8483-9592e6316fb9 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
24162025-02-28T23:17:53.381ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51946
24172025-02-28T23:17:53.381ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51946 req_id = 94534d41-2bb1-4d3f-8dc4-c3cda0db30a9 response_code = 200 uri = /baseboard
24182025-02-28T23:18:12.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52283
24192025-02-28T23:18:12.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52283 req_id = 89c28c38-dc0c-400b-8c23-521cca127f25 response_code = 200 uri = /vpc-routes
24202025-02-28T23:18:12.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24212025-02-28T23:18:12.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52283 req_id = 65bd1c02-7f4d-4edb-a106-901bf24ffd81 response_code = 204 uri = /eip-gateways
24222025-02-28T23:18:12.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52283 req_id = 14b350a8-1404-43c7-b44f-d3bb2d5deb11 response_code = 204 uri = /vpc-routes
24232025-02-28T23:18:12.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35752
24242025-02-28T23:18:12.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35752 req_id = c2bffd79-4d95-4a73-a5cc-913e724da448 response_code = 200 uri = /v2p
24252025-02-28T23:18:12.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44581
24262025-02-28T23:18:12.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24272025-02-28T23:18:12.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24282025-02-28T23:18:12.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44581 req_id = 0e90cb9c-006a-4d40-b08e-ff7e0558e807 response_code = 204 uri = /switch-ports
24292025-02-28T23:18:12.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36827
24302025-02-28T23:18:12.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50842
24312025-02-28T23:18:12.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61774
24322025-02-28T23:18:12.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61774 req_id = a46f1bee-a9e5-4fee-95cd-d8793dede47a response_code = 200 uri = /vpc-routes
24332025-02-28T23:18:12.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36827 req_id = 8c353e93-c555-4655-a895-fd1c6a463672 response_code = 200 uri = /vpc-routes
24342025-02-28T23:18:12.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44581 req_id = 6bb62435-4276-4a03-9fe3-d7c717f93473 response_code = 200 uri = /network-bootstore-config
24352025-02-28T23:18:12.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50842 req_id = f9c80268-cc00-49dc-a4fd-6709e1624f33 response_code = 200 uri = /v2p
24362025-02-28T23:18:12.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24372025-02-28T23:18:12.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36827 req_id = 018a9eeb-ddbf-41c4-9fee-b478cb375179 response_code = 204 uri = /eip-gateways
24382025-02-28T23:18:12.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36827 req_id = 50fcd2ee-71d6-4eb0-b210-e69ff422561d response_code = 204 uri = /vpc-routes
24392025-02-28T23:18:12.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40330
24402025-02-28T23:18:12.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24412025-02-28T23:18:13.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24422025-02-28T23:18:13.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101127 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40330 req_id = 67e05698-5268-4cad-a4c3-de81507e74fa response_code = 204 uri = /switch-ports
24432025-02-28T23:18:13.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39401
24442025-02-28T23:18:13.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24452025-02-28T23:18:13.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61774 req_id = 789620a9-3fcc-402c-b7b7-8cb381847896 response_code = 204 uri = /eip-gateways
24462025-02-28T23:18:13.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40330 req_id = a9e6c85e-8f31-4673-bda5-b4219423a548 response_code = 200 uri = /network-bootstore-config
24472025-02-28T23:18:13.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39401 req_id = ea39450c-3b6d-4a39-ae4e-d9cecba75fae response_code = 200 uri = /v2p
24482025-02-28T23:18:13.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61774 req_id = 6aa8fa0e-aac2-4701-99c7-17f47a526d3a response_code = 204 uri = /vpc-routes
24492025-02-28T23:18:13.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40170
24502025-02-28T23:18:13.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24512025-02-28T23:18:13.173ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24522025-02-28T23:18:13.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92016 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40170 req_id = 39c13105-f4f2-4f4b-816f-5e3771f3a845 response_code = 204 uri = /switch-ports
24532025-02-28T23:18:13.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40170 req_id = 82e15999-f9b9-453d-9d3c-9c51a646a31f response_code = 200 uri = /network-bootstore-config
24542025-02-28T23:18:23.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7625 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = acb6a256-3a52-41ec-a398-cc4330a42c74 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
24552025-02-28T23:18:23.414ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64651
24562025-02-28T23:18:23.414ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64651 req_id = 366bdfc6-caa9-4646-9ea1-eeeec96c33e2 response_code = 200 uri = /baseboard
24572025-02-28T23:18:42.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64076
24582025-02-28T23:18:42.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64076 req_id = 4386380d-f967-4db9-b745-7c781e4d646d response_code = 200 uri = /vpc-routes
24592025-02-28T23:18:42.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24602025-02-28T23:18:42.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64076 req_id = 9b7b4af5-57b9-42fc-b2d7-f656c3c36f59 response_code = 204 uri = /eip-gateways
24612025-02-28T23:18:42.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64076 req_id = 6b866fe5-4939-4cfb-8c41-625e88e677d1 response_code = 204 uri = /vpc-routes
24622025-02-28T23:18:42.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59149
24632025-02-28T23:18:42.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59149 req_id = 63e6e46d-7198-41ad-892f-d6ac5fb69822 response_code = 200 uri = /vpc-routes
24642025-02-28T23:18:42.580ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24652025-02-28T23:18:42.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59149 req_id = e52e25ec-9651-4ec3-b62d-4928f27e5375 response_code = 204 uri = /eip-gateways
24662025-02-28T23:18:42.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59149 req_id = 7ea7f986-aca9-4630-bd29-3edb3c98e744 response_code = 204 uri = /vpc-routes
24672025-02-28T23:18:42.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33803
24682025-02-28T23:18:42.650ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24692025-02-28T23:18:42.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24702025-02-28T23:18:42.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33803 req_id = 24f8e6ef-9c21-4944-97a3-0d4a6c7b70e1 response_code = 204 uri = /switch-ports
24712025-02-28T23:18:42.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51372
24722025-02-28T23:18:42.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51372 req_id = 87e6b8ca-c4fe-476f-8454-80aeccc8c6d9 response_code = 200 uri = /v2p
24732025-02-28T23:18:42.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33803 req_id = 33a7ddc9-c2fe-4e9b-ba29-bff662226902 response_code = 200 uri = /network-bootstore-config
24742025-02-28T23:18:42.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64425
24752025-02-28T23:18:42.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64425 req_id = 9d781a5d-b9e6-4dc6-ae02-867dbaf6e529 response_code = 200 uri = /vpc-routes
24762025-02-28T23:18:42.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24772025-02-28T23:18:42.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64425 req_id = 12309b4e-db6f-4dd1-b59e-6d41b952d80a response_code = 204 uri = /eip-gateways
24782025-02-28T23:18:42.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64425 req_id = 3695d815-6b60-44d4-819c-7dbc7a9418ce response_code = 204 uri = /vpc-routes
24792025-02-28T23:18:42.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49616
24802025-02-28T23:18:42.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49616 req_id = ccf95cbf-f188-44bd-91d3-d47fb0a88d94 response_code = 200 uri = /v2p
24812025-02-28T23:18:42.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36336
24822025-02-28T23:18:42.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36336 req_id = 086758b7-a0f1-4401-a881-bfebf1c74d12 response_code = 200 uri = /v2p
24832025-02-28T23:18:42.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36847
24842025-02-28T23:18:42.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24852025-02-28T23:18:42.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24862025-02-28T23:18:42.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36847 req_id = fe6dea26-2e11-4bcc-ad98-24f7e199172a response_code = 204 uri = /switch-ports
24872025-02-28T23:18:42.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36759
24882025-02-28T23:18:42.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24892025-02-28T23:18:43.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24902025-02-28T23:18:43.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36759 req_id = 6cccf66b-8a7f-4f1c-b92f-131de9a68f8e response_code = 204 uri = /switch-ports
24912025-02-28T23:18:43.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36847 req_id = 712bbf61-3705-4806-9b54-f3c277cddc65 response_code = 200 uri = /network-bootstore-config
24922025-02-28T23:18:43.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36759 req_id = c91e7a14-6a04-4cd1-be15-115e2367a34b response_code = 200 uri = /network-bootstore-config
24932025-02-28T23:18:53.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7328 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = e98f78d2-44b6-40f7-b4d1-6f142de9f302 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
24942025-02-28T23:18:53.448ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43657
24952025-02-28T23:18:53.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43657 req_id = 2740cf77-45b1-4e7d-983c-8f140fc7900e response_code = 200 uri = /baseboard
24962025-02-28T23:19:12.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59904
24972025-02-28T23:19:12.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59904 req_id = 76c67146-4478-45a5-bd33-6a6575c5f2a5 response_code = 200 uri = /vpc-routes
24982025-02-28T23:19:12.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
24992025-02-28T23:19:12.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59904 req_id = d6189ce1-4d2b-4954-9035-b3acf623aea3 response_code = 204 uri = /eip-gateways
25002025-02-28T23:19:12.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55478
25012025-02-28T23:19:12.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55478 req_id = 01ccda54-265c-4357-ac22-647f40ad2e8a response_code = 200 uri = /v2p
25022025-02-28T23:19:12.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47538
25032025-02-28T23:19:12.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25042025-02-28T23:19:12.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47538 req_id = 10b9fe51-8e08-411f-a499-59b8d8549349 response_code = 200 uri = /artifacts
25052025-02-28T23:19:12.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58148
25062025-02-28T23:19:12.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58148 req_id = bde87d61-4c0a-497d-af30-252fee2d0b64 response_code = 200 uri = /vpc-routes
25072025-02-28T23:19:12.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59904 req_id = 456b5f45-1dd7-4e09-943f-5eba692ac471 response_code = 204 uri = /vpc-routes
25082025-02-28T23:19:12.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52637
25092025-02-28T23:19:12.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52637 req_id = d2ad9f82-c732-4216-b76d-072f9fd7ddcf response_code = 200 uri = /vpc-routes
25102025-02-28T23:19:12.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37607
25112025-02-28T23:19:12.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25122025-02-28T23:19:12.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 440 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37607 req_id = 6e6d19b7-b6db-40ef-8cbf-a5a633061d40 response_code = 200 uri = /artifacts
25132025-02-28T23:19:13.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
25142025-02-28T23:19:13.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52637 req_id = fa14d56a-7121-4574-beed-551848a3e034 response_code = 204 uri = /eip-gateways
25152025-02-28T23:19:13.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52637 req_id = 167a4026-68c1-4135-ae07-184146a7f1b4 response_code = 204 uri = /vpc-routes
25162025-02-28T23:19:13.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56193
25172025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25182025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25192025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25202025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25212025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25222025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25232025-02-28T23:19:13.041ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25242025-02-28T23:19:13.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 426 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56193 req_id = 9ca4fb44-885a-4fc8-b612-9a093594d8e3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25252025-02-28T23:19:13.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33907
25262025-02-28T23:19:13.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25272025-02-28T23:19:13.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25282025-02-28T23:19:13.055ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
25292025-02-28T23:19:13.059ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
25302025-02-28T23:19:13.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
25312025-02-28T23:19:13.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 608 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58148 req_id = cb1aaeff-c390-4cdd-8357-9ebd91da84b3 response_code = 204 uri = /eip-gateways
25322025-02-28T23:19:13.074ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25332025-02-28T23:19:13.074ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e6859987-fd24-4257-800d-91c0f9f61334
25342025-02-28T23:19:13.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52933
25352025-02-28T23:19:13.079ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25362025-02-28T23:19:13.102ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25372025-02-28T23:19:13.102ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402
25382025-02-28T23:19:13.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34910
25392025-02-28T23:19:13.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50609
25402025-02-28T23:19:13.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34826
25412025-02-28T23:19:13.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35521
25422025-02-28T23:19:13.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25432025-02-28T23:19:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58148 req_id = 6ae4e9a5-018a-45b9-abf6-cb06ffadfe84 response_code = 204 uri = /vpc-routes
25442025-02-28T23:19:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34910 req_id = dfed26e1-ebee-4f71-a288-8de2357449ed response_code = 200 uri = /v2p
25452025-02-28T23:19:13.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50609 req_id = 4bb43437-79e6-4de8-9160-3eb4d36e7c05 response_code = 200 uri = /artifacts
25462025-02-28T23:19:13.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25472025-02-28T23:19:13.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25482025-02-28T23:19:13.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e
25492025-02-28T23:19:13.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25502025-02-28T23:19:13.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25512025-02-28T23:19:13.150ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
25522025-02-28T23:19:13.150ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
25532025-02-28T23:19:13.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36661
25542025-02-28T23:19:13.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25552025-02-28T23:19:13.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3
25562025-02-28T23:19:13.177ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572025-02-28T23:19:13.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e6859987-fd24-4257-800d-91c0f9f61334
25582025-02-28T23:19:13.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58078
25592025-02-28T23:19:13.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25602025-02-28T23:19:13.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52933 req_id = 32b9f85d-9a75-4989-9491-ed2e5a436f47 response_code = 204 uri = /switch-ports
25612025-02-28T23:19:13.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25622025-02-28T23:19:13.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25632025-02-28T23:19:13.198ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/config/omicron-zones.json file = common/src/ledger.rs:177
25642025-02-28T23:19:13.202ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652025-02-28T23:19:13.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402
25662025-02-28T23:19:13.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34021
25672025-02-28T23:19:13.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52933 req_id = 96a37a9c-49f3-4b32-911e-f009f123d6cc response_code = 200 uri = /network-bootstore-config
25682025-02-28T23:19:13.207ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/config/omicron-zones.json file = common/src/ledger.rs:177
25692025-02-28T23:19:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34021 req_id = cd8f9235-e47d-483a-a882-dc13b6f84150 response_code = 200 uri = /v2p
25702025-02-28T23:19:13.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25712025-02-28T23:19:13.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f
25722025-02-28T23:19:13.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6859987-fd24-4257-800d-91c0f9f61334 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25732025-02-28T23:19:13.234ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e6859987-fd24-4257-800d-91c0f9f61334
25742025-02-28T23:19:13.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25752025-02-28T23:19:13.251ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25762025-02-28T23:19:13.251ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e
25772025-02-28T23:19:13.268ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25782025-02-28T23:19:13.268ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17d61349-66a6-4ab5-a1a2-619a947659ed
25792025-02-28T23:19:13.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43076
25802025-02-28T23:19:13.290ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d43be9fe-82e2-4aaf-b9fa-0c9161803402 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25812025-02-28T23:19:13.290ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d43be9fe-82e2-4aaf-b9fa-0c9161803402
25822025-02-28T23:19:13.297ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25832025-02-28T23:19:13.297ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25842025-02-28T23:19:13.298ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25852025-02-28T23:19:13.298ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25862025-02-28T23:19:13.298ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25872025-02-28T23:19:13.298ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25882025-02-28T23:19:13.298ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25892025-02-28T23:19:13.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43076 req_id = e2e00729-12e8-463f-8f9b-52b73b2fa0fb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25902025-02-28T23:19:13.304ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25912025-02-28T23:19:13.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3
25922025-02-28T23:19:13.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39183
25932025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a290d01-1e02-45af-9047-399e5ae978de, kind: Service { id: b0e3cb3e-c072-4223-920e-1364ded6c14d }, name: Name("external-dns-b0e3cb3e-c072-4223-920e-1364ded6c14d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 42])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: de44f73f-74cb-4b03-b1ac-1c93c740f4f9, kind: Service { id: 10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb }, name: Name("external-dns-10f74d5b-7ea2-4e1c-8146-b62b27e7cbbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 43])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0bce6cc6-61d4-4815-8909-e3873f63e772, kind: Service { id: a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2 }, name: Name("nexus-a58b1575-0a7a-43f2-aa27-0e0d2c6cfee2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77edd049-cc50-422c-854a-aca0e3ffc4a4, kind: Service { id: f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b }, name: Name("nexus-f0f730d6-b780-4c5f-a10d-e9c9cbe4d41b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93fe7a42-d342-4d11-b8c6-d9214c059ee9, kind: Service { id: 431cd3aa-3cd0-477f-978b-e37653464252 }, name: Name("nexus-431cd3aa-3cd0-477f-978b-e37653464252"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25942025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25952025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25962025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25972025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25982025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25992025-02-28T23:19:13.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26002025-02-28T23:19:13.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39183 req_id = 6b5d1f50-b67c-49be-b972-157c51ebda7a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26012025-02-28T23:19:13.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26022025-02-28T23:19:13.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35521 req_id = 32cdfcab-affb-40fd-bf90-8fdbc6c59d58 response_code = 204 uri = /switch-ports
26032025-02-28T23:19:13.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35521 req_id = 791d28dd-4b2c-443e-b09f-375833b80de5 response_code = 200 uri = /network-bootstore-config
26042025-02-28T23:19:13.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26052025-02-28T23:19:13.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97
26062025-02-28T23:19:13.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 78d41e7e-6bd1-474a-9f5a-a213410e963e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26072025-02-28T23:19:13.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_78d41e7e-6bd1-474a-9f5a-a213410e963e
26082025-02-28T23:19:13.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-02-28T23:19:13.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f
26102025-02-28T23:19:13.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26112025-02-28T23:19:13.367ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122025-02-28T23:19:13.367ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9395a765-3cd5-4500-919f-891f129f4358
26132025-02-28T23:19:13.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f24b7d67-4be5-4757-8460-2d158a9a12d3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26142025-02-28T23:19:13.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f24b7d67-4be5-4757-8460-2d158a9a12d3
26152025-02-28T23:19:13.395ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26162025-02-28T23:19:13.395ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17d61349-66a6-4ab5-a1a2-619a947659ed
26172025-02-28T23:19:13.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-02-28T23:19:13.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d5534d82-e391-4535-be4a-591aedf1d99f
26192025-02-28T23:19:13.422ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97ab7085-8654-402b-93a4-8c1e0d981e5f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26202025-02-28T23:19:13.422ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97ab7085-8654-402b-93a4-8c1e0d981e5f
26212025-02-28T23:19:13.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264153 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36661 req_id = 215f11ad-8a99-49f2-ad77-1fc1340e72bd response_code = 204 uri = /switch-ports
26222025-02-28T23:19:13.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36661 req_id = 6998db1b-01cc-4d4c-9969-23002727dc20 response_code = 200 uri = /network-bootstore-config
26232025-02-28T23:19:13.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 372015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33907 req_id = 59619b52-2b27-43a9-bca2-5a216ec93d62 response_code = 200 uri = /inventory
26242025-02-28T23:19:13.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252025-02-28T23:19:13.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97
26262025-02-28T23:19:13.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17d61349-66a6-4ab5-a1a2-619a947659ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272025-02-28T23:19:13.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17d61349-66a6-4ab5-a1a2-619a947659ed
26282025-02-28T23:19:13.471ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-02-28T23:19:13.472ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9395a765-3cd5-4500-919f-891f129f4358
26302025-02-28T23:19:13.496ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312025-02-28T23:19:13.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d5534d82-e391-4535-be4a-591aedf1d99f
26322025-02-28T23:19:13.508ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d1369c52-7c7c-4b54-bdd3-71ca57ff7e97 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332025-02-28T23:19:13.508ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d1369c52-7c7c-4b54-bdd3-71ca57ff7e97
26342025-02-28T23:19:13.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 378990 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34826 req_id = dbadf09c-d10f-43bc-ae68-67ff1926de4a response_code = 200 uri = /inventory
26352025-02-28T23:19:13.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9395a765-3cd5-4500-919f-891f129f4358 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362025-02-28T23:19:13.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9395a765-3cd5-4500-919f-891f129f4358
26372025-02-28T23:19:13.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5534d82-e391-4535-be4a-591aedf1d99f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26382025-02-28T23:19:13.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d5534d82-e391-4535-be4a-591aedf1d99f
26392025-02-28T23:19:13.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 376394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58078 req_id = 9b8b24ac-d4cc-4f8d-b688-62c99b2ef4f0 response_code = 200 uri = /inventory
26402025-02-28T23:19:23.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8279 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = e88d5cb1-b504-49fe-a4fe-a62e3b8e27e4 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
26412025-02-28T23:19:23.483ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45656
26422025-02-28T23:19:23.483ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45656 req_id = b94d9cfe-a7c3-4c0d-b29c-1081e16fe420 response_code = 200 uri = /baseboard
26432025-02-28T23:19:42.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63356
26442025-02-28T23:19:42.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63356 req_id = c14ed6fe-5bb4-401a-a02f-7a17453f588c response_code = 200 uri = /vpc-routes
26452025-02-28T23:19:42.579ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
26462025-02-28T23:19:42.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63356 req_id = fd354365-5e35-4c40-8bbb-af2369302400 response_code = 204 uri = /eip-gateways
26472025-02-28T23:19:42.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63356 req_id = 12530e13-6fe4-4449-a1be-0cd4ba294da9 response_code = 204 uri = /vpc-routes
26482025-02-28T23:19:42.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52794
26492025-02-28T23:19:42.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26502025-02-28T23:19:42.692ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26512025-02-28T23:19:42.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52794 req_id = 80d0b33e-1e0f-4a99-bbef-540a57fafe36 response_code = 204 uri = /switch-ports
26522025-02-28T23:19:42.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58262
26532025-02-28T23:19:42.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52273
26542025-02-28T23:19:42.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37688
26552025-02-28T23:19:42.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37688 req_id = 38e615c0-f529-42d0-8057-4c5a0d0e1256 response_code = 200 uri = /vpc-routes
26562025-02-28T23:19:42.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58262 req_id = 5335d5c6-50c9-400d-869a-7779d3e4e01d response_code = 200 uri = /vpc-routes
26572025-02-28T23:19:42.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52794 req_id = 90f24e8e-d8eb-45b9-8f29-45c8727a593c response_code = 200 uri = /network-bootstore-config
26582025-02-28T23:19:42.781ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26592025-02-28T23:19:42.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61720
26602025-02-28T23:19:42.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61720 req_id = b7f919fc-b332-4368-8ce5-ca791702c915 response_code = 200 uri = /v2p
26612025-02-28T23:19:42.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63896
26622025-02-28T23:19:42.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63896 req_id = 0de65d3f-81d1-4bed-bf49-eff516dda11f response_code = 200 uri = /v2p
26632025-02-28T23:19:42.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
26642025-02-28T23:19:42.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58262 req_id = f1f5fa03-1af2-4ae7-9c3e-94d578b1b9af response_code = 204 uri = /eip-gateways
26652025-02-28T23:19:42.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58262 req_id = d8adefe0-377f-49d7-a6f8-7ca29a067b27 response_code = 204 uri = /vpc-routes
26662025-02-28T23:19:42.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55122
26672025-02-28T23:19:42.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55122 req_id = da0a0f3e-8539-4d65-b2fe-ca5b27d29cc0 response_code = 200 uri = /v2p
26682025-02-28T23:19:42.833ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
26692025-02-28T23:19:42.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37688 req_id = 8ce0693b-b3b3-4e86-b892-2559c05786e4 response_code = 204 uri = /eip-gateways
26702025-02-28T23:19:42.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26712025-02-28T23:19:42.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 414 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37688 req_id = b159ac35-4f78-453d-aa2c-740649632aa4 response_code = 204 uri = /vpc-routes
26722025-02-28T23:19:42.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38954
26732025-02-28T23:19:42.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26742025-02-28T23:19:42.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130564 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52273 req_id = a2116d62-b0cb-485f-8dc8-53cd6a73ee01 response_code = 204 uri = /switch-ports
26752025-02-28T23:19:42.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52273 req_id = f8121aaf-585c-4900-a74e-89f397b63575 response_code = 200 uri = /network-bootstore-config
26762025-02-28T23:19:42.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26772025-02-28T23:19:43.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38954 req_id = d5892ed3-963e-4cdb-abfa-34087bb921ee response_code = 204 uri = /switch-ports
26782025-02-28T23:19:43.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38954 req_id = 12d7edab-63b1-4921-88f0-0f330aa14399 response_code = 200 uri = /network-bootstore-config
26792025-02-28T23:19:53.280ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6853 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = a31e08f1-bcb7-48f8-997c-f905a17b9110 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
26802025-02-28T23:19:53.518ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38224
26812025-02-28T23:19:53.518ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38224 req_id = 6122b2c4-a45e-477a-ad43-51c875f11036 response_code = 200 uri = /baseboard
26822025-02-28T23:20:12.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45754
26832025-02-28T23:20:12.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45754 req_id = 52adfd84-d7a7-4928-a9af-cd2aa01a1c52 response_code = 200 uri = /vpc-routes
26842025-02-28T23:20:12.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39559
26852025-02-28T23:20:12.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39559 req_id = dcb3a58d-1797-49d6-88d5-929d14c46949 response_code = 200 uri = /vpc-routes
26862025-02-28T23:20:12.830ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
26872025-02-28T23:20:12.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45754 req_id = be660369-fa2c-4e30-b115-8ed8b6a8e669 response_code = 204 uri = /eip-gateways
26882025-02-28T23:20:12.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
26892025-02-28T23:20:12.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39559 req_id = fa95700f-a994-486c-92cd-c3f847079c67 response_code = 204 uri = /eip-gateways
26902025-02-28T23:20:12.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39559 req_id = 3774e15f-6438-42c9-a884-3ebcbb3dcec3 response_code = 204 uri = /vpc-routes
26912025-02-28T23:20:12.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65422
26922025-02-28T23:20:12.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65422 req_id = f3a9a50c-7d62-423e-845e-dfc04d548eb0 response_code = 200 uri = /v2p
26932025-02-28T23:20:12.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45754 req_id = a00faa1d-4b0d-4321-9308-b2bd34f344f3 response_code = 204 uri = /vpc-routes
26942025-02-28T23:20:12.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47519
26952025-02-28T23:20:12.901ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26962025-02-28T23:20:12.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26972025-02-28T23:20:13.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47519 req_id = 3230e384-9fe1-4236-a633-0606c9454734 response_code = 204 uri = /switch-ports
26982025-02-28T23:20:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63536
26992025-02-28T23:20:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38914
27002025-02-28T23:20:13.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 06077696-1d69-46e0-a347-f409cc0de891 response_code = 200 uri = /vpc-routes
27012025-02-28T23:20:13.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27022025-02-28T23:20:13.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38968
27032025-02-28T23:20:13.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47519 req_id = 5bbb22db-051a-4434-90d9-b2ba88e816c3 response_code = 200 uri = /network-bootstore-config
27042025-02-28T23:20:13.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38968 req_id = 67020be4-419a-4f50-97f8-0f64eec2d006 response_code = 200 uri = /v2p
27052025-02-28T23:20:13.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52331
27062025-02-28T23:20:13.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52331 req_id = f8b1f882-6911-4c89-8878-9317f0cdc141 response_code = 200 uri = /v2p
27072025-02-28T23:20:13.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27082025-02-28T23:20:13.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
27092025-02-28T23:20:13.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 63ed0274-1725-49ca-920e-eb948bf0446f response_code = 204 uri = /eip-gateways
27102025-02-28T23:20:13.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 3d2472ad-4392-48a5-997f-cd90557b5a6f response_code = 204 uri = /vpc-routes
27112025-02-28T23:20:13.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40720
27122025-02-28T23:20:13.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27132025-02-28T23:20:13.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63536 req_id = 9b31ee98-27c7-4094-9e9c-fd0834a7f7e6 response_code = 204 uri = /switch-ports
27142025-02-28T23:20:13.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63536 req_id = 7b343d38-0fe6-44b3-a6ad-c537dd5c82fa response_code = 200 uri = /network-bootstore-config
27152025-02-28T23:20:13.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27162025-02-28T23:20:13.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40720 req_id = 028214f1-b239-4b92-94a6-e0b5fca2ebed response_code = 204 uri = /switch-ports
27172025-02-28T23:20:13.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40720 req_id = 3ea95194-4322-4158-973d-c2b1a376e9f1 response_code = 200 uri = /network-bootstore-config
27182025-02-28T23:20:23.282ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7611 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = c991fc94-040b-47b9-87d7-575544c92635 response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
27192025-02-28T23:20:23.550ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64704
27202025-02-28T23:20:23.550ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64704 req_id = 8a65425c-7f44-425d-bea6-7f3f446d3820 response_code = 200 uri = /baseboard
27212025-02-28T23:20:41.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63770
27222025-02-28T23:20:41.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63770 req_id = db80b18f-ee89-40a2-a297-1f281d2788a4 response_code = 200 uri = /v2p
27232025-02-28T23:20:41.522ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16528582) }
27242025-02-28T23:20:41.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63770 req_id = 2712dec5-1f18-4a99-b618-3c47e52dd5ee response_code = 204 uri = /v2p
27252025-02-28T23:20:41.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52796
27262025-02-28T23:20:41.668ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16528582))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ecb4a901-b7e4-4fe3-890e-91219f2ac295, slot: 0, read_only: false, vcr_json: .., name: "disk-7e5982ace63" }], boot_settings: Some(InstanceBootSettings { order: [ecb4a901-b7e4-4fe3-890e-91219f2ac295] }), cloud_init_bytes: Some(..) } instance_id = e6b26165-318b-4f31-845c-5791b1082c90 metadata = InstanceMetadata { silo_id: 6457ae95-4f7f-479e-876b-2a36a8910b4c, project_id: e6acc616-8db7-4b4c-ad5c-471df4f89e51 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T23:20:41.658208156Z }
27272025-02-28T23:20:41.668ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 migration_id = None propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27282025-02-28T23:20:41.668ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 migration_id = None propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16528582))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b19fe66-d1ef-4146-95c8-04e86ba5598d, kind: Instance { id: e6b26165-318b-4f31-845c-5791b1082c90 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16528582), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ecb4a901-b7e4-4fe3-890e-91219f2ac295, slot: 0, read_only: false, vcr_json: .., name: "disk-7e5982ace63" }], boot_settings: Some(InstanceBootSettings { order: [ecb4a901-b7e4-4fe3-890e-91219f2ac295] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T23:20:41.658208156Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27292025-02-28T23:20:41.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12730 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52796 req_id = 2741e909-2269-4bd4-99c0-28f45e759c4a response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57
27302025-02-28T23:20:41.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33507
27312025-02-28T23:20:41.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33507 req_id = 7a9d65db-04fe-4426-8e38-4eb7295efb17 response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57/state
27322025-02-28T23:20:41.783ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16528582 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27332025-02-28T23:20:41.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27342025-02-28T23:20:41.823ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57 file = illumos-utils/src/zone.rs:325 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27352025-02-28T23:20:41.846ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57 file = illumos-utils/src/zone.rs:363 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27362025-02-28T23:20:41.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39883
27372025-02-28T23:20:41.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39883 req_id = f59e5efd-f9dc-407f-8496-007dc194fde2 response_code = 200 uri = /vpc-routes
27382025-02-28T23:20:41.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {7b19fe66-d1ef-4146-95c8-04e86ba5598d: {10.151.1.175: {a8dfb345-4e5e-4ffe-972b-74f17009d794}, 10.151.1.176: {a8dfb345-4e5e-4ffe-972b-74f17009d794}}} }
27392025-02-28T23:20:42.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57381
27402025-02-28T23:20:42.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57381 req_id = 49b8cff0-2bb0-44a1-b6f2-9ba2ace1175d response_code = 200 uri = /v2p
27412025-02-28T23:20:42.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50035
27422025-02-28T23:20:42.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40788
27432025-02-28T23:20:42.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61524
27442025-02-28T23:20:42.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61524 req_id = a5c78e15-e64e-4534-9129-52147a6cf2b4 response_code = 200 uri = /vpc-routes
27452025-02-28T23:20:42.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {7b19fe66-d1ef-4146-95c8-04e86ba5598d: {10.151.1.176: {a8dfb345-4e5e-4ffe-972b-74f17009d794}, 10.151.1.175: {a8dfb345-4e5e-4ffe-972b-74f17009d794}}} }
27462025-02-28T23:20:42.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61524 req_id = 867fb224-f593-47d2-b580-49d49cd1fed1 response_code = 204 uri = /eip-gateways
27472025-02-28T23:20:42.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47426
27482025-02-28T23:20:42.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27492025-02-28T23:20:42.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27502025-02-28T23:20:42.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47426 req_id = e855487a-66a6-4ab0-a2c7-f94c966faf93 response_code = 204 uri = /switch-ports
27512025-02-28T23:20:42.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41193
27522025-02-28T23:20:42.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40912
27532025-02-28T23:20:42.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45581
27542025-02-28T23:20:42.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27552025-02-28T23:20:42.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47426 req_id = e4f80479-49ff-40cd-88b7-4f933e8edf89 response_code = 200 uri = /network-bootstore-config
27562025-02-28T23:20:42.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40912 req_id = 4e1527fd-a5b8-456f-b7c8-5671613c6b7a response_code = 200 uri = /vpc-routes
27572025-02-28T23:20:42.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27582025-02-28T23:20:42.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {7b19fe66-d1ef-4146-95c8-04e86ba5598d: {10.151.1.176: {a8dfb345-4e5e-4ffe-972b-74f17009d794}, 10.151.1.175: {a8dfb345-4e5e-4ffe-972b-74f17009d794}}} }
27592025-02-28T23:20:42.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40912 req_id = 3eb22d88-a39f-4bd0-a3d9-87f404b4b824 response_code = 204 uri = /eip-gateways
27602025-02-28T23:20:42.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41689
27612025-02-28T23:20:42.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41689 req_id = 06491017-6298-43b3-865c-cdefb591efd8 response_code = 200 uri = /v2p
27622025-02-28T23:20:42.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61694
27632025-02-28T23:20:42.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61694 req_id = 40d5bd53-2ab5-4229-9a8e-1b0bd850a5c0 response_code = 200 uri = /v2p
27642025-02-28T23:20:42.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41193 req_id = cbb502ee-4c9b-4fc6-8ed9-e64aed38e26c response_code = 204 uri = /switch-ports
27652025-02-28T23:20:42.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41193 req_id = baa5586c-76b6-472b-96c2-7c184e89a50f response_code = 200 uri = /network-bootstore-config
27662025-02-28T23:20:43.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51929
27672025-02-28T23:20:43.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27682025-02-28T23:20:43.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27692025-02-28T23:20:43.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51929 req_id = 35348d2f-2721-42cf-ab42-c6e9f5966764 response_code = 204 uri = /switch-ports
27702025-02-28T23:20:43.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51929 req_id = 3a5cad6d-2b15-4317-9eb7-19486e8e46f6 response_code = 200 uri = /network-bootstore-config
27712025-02-28T23:20:43.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61524 req_id = e9e27181-047e-4246-9a96-8b5ba58074c7 response_code = 204 uri = /vpc-routes
27722025-02-28T23:20:43.164ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 08de2080-173c-4505-b3c8-630c48ab5951, version: 3 } old_vers = RouterVersion { router_id: 08de2080-173c-4505-b3c8-630c48ab5951, version: 3 } subnet = RouterId { vni: Vni(16528582), kind: System }
27732025-02-28T23:20:43.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40912 req_id = e469bd71-5710-4b7c-b098-50b14c1e0ddb response_code = 204 uri = /vpc-routes
27742025-02-28T23:20:43.543ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27752025-02-28T23:20:43.543ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57 zone file = illumos-utils/src/running_zone.rs:489 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27762025-02-28T23:20:43.722ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 58.932073ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27772025-02-28T23:20:43.798ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 50.260081ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27782025-02-28T23:20:43.863ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 173.367964ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27792025-02-28T23:20:44.054ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 395.713136ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27802025-02-28T23:20:44.466ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 493.446016ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27812025-02-28T23:20:44.980ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 916.242768ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27822025-02-28T23:20:45.908ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 683.050005ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27832025-02-28T23:20:46.603ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 1.137390783s file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27842025-02-28T23:20:47.753ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 992.736782ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 zone = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
27852025-02-28T23:20:48.777ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57 file = sled-agent/src/instance.rs:2133 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27862025-02-28T23:20:48.787ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 68.812373ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27872025-02-28T23:20:48.865ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 91.092501ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27882025-02-28T23:20:48.966ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 242.474308ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27892025-02-28T23:20:49.218ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57") failed: Property not found. retry in 259.348464ms file = illumos-utils/src/svc.rs:42 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27902025-02-28T23:20:49.488ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27912025-02-28T23:20:49.526ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27922025-02-28T23:20:49.612ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27932025-02-28T23:20:49.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6729073 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45581 req_id = c4238ad2-d662-4eeb-8a06-a8ae782d013a response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57/state
27942025-02-28T23:20:49.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7031689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50035 req_id = 589e84e4-e4dc-446c-89b9-70428717faaa response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57/state
27952025-02-28T23:20:49.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6931041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40788 req_id = 6370cc07-f2cc-4b20-8a74-92ed0338a573 response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57/state
27962025-02-28T23:20:49.614ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
27972025-02-28T23:20:49.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7707351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39883 req_id = b5169f3f-898a-487c-a99a-5a6439330eca response_code = 204 uri = /eip-gateways
27982025-02-28T23:20:49.615ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-28T23:20:49.615211252Z } file = sled-agent/src/instance.rs:842 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
27992025-02-28T23:20:49.615ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T23:20:49.615211252Z } propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28002025-02-28T23:20:49.615ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T23:20:49.615211252Z }, migration_in: None, migration_out: None }
28012025-02-28T23:20:49.700ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-28T23:20:49.700295395Z } file = sled-agent/src/instance.rs:842 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28022025-02-28T23:20:49.700ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T23:20:49.700295395Z } propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28032025-02-28T23:20:49.700ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T23:20:49.700295395Z }, migration_in: None, migration_out: None }
28042025-02-28T23:20:49.779ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 08de2080-173c-4505-b3c8-630c48ab5951, version: 3 } old_vers = RouterVersion { router_id: 08de2080-173c-4505-b3c8-630c48ab5951, version: 3 } subnet = RouterId { vni: Vni(16528582), kind: System }
28052025-02-28T23:20:49.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39883 req_id = 7d7ba3c5-64ef-4349-be8a-5a7243532edf response_code = 204 uri = /vpc-routes
28062025-02-28T23:20:49.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63324
28072025-02-28T23:20:49.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63324 req_id = 3f0e7983-e338-4011-9221-3e82655e1af2 response_code = 200 uri = /vpc-routes
28082025-02-28T23:20:49.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {7b19fe66-d1ef-4146-95c8-04e86ba5598d: {10.151.1.175: {a8dfb345-4e5e-4ffe-972b-74f17009d794}, 10.151.1.176: {a8dfb345-4e5e-4ffe-972b-74f17009d794}}} }
28092025-02-28T23:20:49.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63324 req_id = dbb6e27e-f94d-4bfe-91db-d7526b84e2a7 response_code = 204 uri = /eip-gateways
28102025-02-28T23:20:49.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63324 req_id = 3a445e19-60c0-4a68-8181-9479023b3267 response_code = 204 uri = /vpc-routes
28112025-02-28T23:20:53.281ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8169 local_addr = [fd00:1122:3344:101::1]:54102 method = GET remote_addr = [fd00:1122:3344:101::d]:59901 req_id = 8062b9d2-f25b-45f9-94e5-e240591ba90f response_code = 200 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b uri = /eb977560-79bb-4094-9f3c-0c8f67caef5b
28122025-02-28T23:20:53.582ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45273
28132025-02-28T23:20:53.582ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45273 req_id = 29984542-2eef-4554-8d07-f1cc7ae852a8 response_code = 200 uri = /baseboard
28142025-02-28T23:20:59.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47161
28152025-02-28T23:20:59.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47161 req_id = ae20d2f0-5614-46e1-b925-15a28b52ba78 response_code = 200 uri = /vmms/d3b8dd77-8df2-4301-896a-4ef15f09db57/state
28162025-02-28T23:20:59.282ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-28T23:20:59.282835991Z } file = sled-agent/src/instance.rs:842 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28172025-02-28T23:20:59.282ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T23:20:59.282835991Z } propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28182025-02-28T23:20:59.282ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T23:20:59.282835991Z }, migration_in: None, migration_out: None }
28192025-02-28T23:20:59.295ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-28T23:20:59.295532555Z } file = sled-agent/src/instance.rs:842 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28202025-02-28T23:20:59.295ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-28T23:20:59.295532555Z } propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28212025-02-28T23:20:59.295ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28222025-02-28T23:20:59.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28232025-02-28T23:20:59.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28242025-02-28T23:20:59.297ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/566d44c0-a314-4b53-9402-fb067e4e8db8/debug/bundle/zone", "/pool/int/a587e7a0-bc40-4e66-bda3-e4649e82a46e/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/e6859987-fd24-4257-800d-91c0f9f61334/crypt/debug", "/pool/ext/d43be9fe-82e2-4aaf-b9fa-0c9161803402/crypt/debug", "/pool/ext/78d41e7e-6bd1-474a-9f5a-a213410e963e/crypt/debug", "/pool/ext/f24b7d67-4be5-4757-8460-2d158a9a12d3/crypt/debug", "/pool/ext/97ab7085-8654-402b-93a4-8c1e0d981e5f/crypt/debug", "/pool/ext/17d61349-66a6-4ab5-a1a2-619a947659ed/crypt/debug", "/pool/ext/d1369c52-7c7c-4b54-bdd3-71ca57ff7e97/crypt/debug", "/pool/ext/9395a765-3cd5-4500-919f-891f129f4358/crypt/debug", "/pool/ext/d5534d82-e391-4535-be4a-591aedf1d99f/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57
28252025-02-28T23:20:59.923ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57", bundle_id: 9677bb08-04f5-4aea-835c-50d77d881f0d }, time_created: 2025-02-28T23:20:59.297864380Z, version: 0, cause: TerminatedInstance }
28262025-02-28T23:20:59.923ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d3b8dd77-8df2-4301-896a-4ef15f09db57 file = sled-agent/src/instance.rs:1376 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28272025-02-28T23:21:01.674ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28282025-02-28T23:21:01.691ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(16528582), kind: System }
28292025-02-28T23:21:01.691ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(16528582), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28302025-02-28T23:21:01.692ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T23:21:01.691984867Z }, migration_in: None, migration_out: None }
28312025-02-28T23:21:01.720ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T23:21:01.691984867Z }, migration_in: None, migration_out: None }
28322025-02-28T23:21:01.725ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = e6b26165-318b-4f31-845c-5791b1082c90 propolis_id = d3b8dd77-8df2-4301-896a-4ef15f09db57
28332025-02-28T23:21:02.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45045
28342025-02-28T23:21:02.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45045 req_id = b42dd086-334b-4939-ad91-9da131af1470 response_code = 200 uri = /vpc-routes
28352025-02-28T23:21:02.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
28362025-02-28T23:21:02.232ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b
28372025-02-28T23:21:02.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45045 req_id = 2b4b3112-6bbb-407d-a6c7-8c2a3e052380 response_code = 204 uri = /eip-gateways
28382025-02-28T23:21:02.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45045 req_id = f02363da-4a62-4be3-a59d-27f993a6415d response_code = 204 uri = /vpc-routes
28392025-02-28T23:21:02.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46195
28402025-02-28T23:21:02.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46195 req_id = c082124e-ff61-4103-850d-5f3bebd7f02f response_code = 200 uri = /v2p
28412025-02-28T23:21:03.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47011
28422025-02-28T23:21:03.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47011 req_id = f8c990cb-c962-4ec2-8321-8c6fcae17b03 response_code = 200 uri = /v2p
28432025-02-28T23:21:03.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36085
28442025-02-28T23:21:03.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36085 req_id = 43e44b64-d416-4c9e-9d24-a4f3b467cb94 response_code = 200 uri = /vpc-routes
28452025-02-28T23:21:03.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
28462025-02-28T23:21:03.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36085 req_id = 95149421-8e74-4c75-ab33-90f520db3879 response_code = 204 uri = /eip-gateways
28472025-02-28T23:21:03.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36085 req_id = aa5f99c1-98f6-4e30-892b-925188c732b0 response_code = 204 uri = /vpc-routes
28482025-02-28T23:21:03.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56678
28492025-02-28T23:21:03.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56678 req_id = 7dfdf0cc-b4fb-4e9d-9cae-181332ac5906 response_code = 200 uri = /vpc-routes
28502025-02-28T23:21:03.780ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = eb977560-79bb-4094-9f3c-0c8f67caef5b values = ExternalIpGatewayMap { mappings: {} }
28512025-02-28T23:21:03.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56678 req_id = 5c242067-216d-44ce-8b22-6f1369935b55 response_code = 204 uri = /eip-gateways
28522025-02-28T23:21:03.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56678 req_id = 2a8d408c-f654-4700-b7d3-6fcdaab1eff1 response_code = 204 uri = /vpc-routes